Do you surf the web in front of the TV, or tweet what you are watching? EU-funded researchers are creating technologies that combine web, social media and TV to enhance our experience and interactions across media.
Research shows that consumers watch TV and use the web simultaneously for up to 3.5 hours daily and 42 % of UK adults discussed the programmes they were watching on social networks. Digital providers and broadcasters are always trying to improve entertainment and combining social media, the web and TV into a single user experience is an important step.
NoTube (Networks and ontologies for the transformation and unification of broadcasting and the internet), a European project, brought the digital and broadcasting industries together, along with experts in platform integration, with the aim of linking media together so consumers can watch shows and interact with friends regardless of the devices they use.
'Our prototypes show that the "Web+TV" experiences which most benefit viewers and users will be those using open standards and that work across different hardware, software and service providers. We have tried to develop solutions that give viewers choice and flexibility,' explains Dan Brickley, a researcher at VU University Amsterdam, the Netherlands, one of the lead researchers in the project.
The key to NoTube's approach is 'linked data', where information about a viewer - such as preferences, social networks, contacts and favourite shows - is stored 'in the cloud'. The data may be held in different databases and formats but it is made accessible by conforming to recognised industry standards for data structure, storage, access and linking.
'The concept of linked data allowed the NoTube team to set reference standards for online publishers. This made it possible, for example, for broadcasters to create personalised news environments and online programme guides, showing users what they most want to see. Moreover, these work across devices and in multiple languages,' says Brickley.
'When NoTube launched, our plan to bring the web and TV closer together via shared data models and content across multiple devices was ambitious and visionary,' Brickley continues. 'Today, the TV industry has caught up, but their cross-platform and personalised services are proprietary. The results and prototypes from NoTube are now more relevant than ever and show the way forward to develop personalised TV applications where the user still controls their data.'
With a vast array of devices and solutions marketed to viewers, it is difficult to achieve a consistent experience when linking online activity and viewing. The NoTube project looked at how this Web+TV combination could work from every angle, developing user interfaces along with underlying technology standards to support interoperability and data linking.
Is linked data secure?
The development of cross-platform solutions was a key focus of the team. 'Hardware engineers at TV companies won't necessarily be skilled at making highly usable programme guide catalogues, or recommendation engines, for example,' explains Brickley. 'As the number of TV channels increases, being able to find and filter the programmes you want will be really useful. We developed a prototype recommendation engine and sharing system which solves this problem and which can be deployed on any media platform.'
Systems using personal data must be secure and respect privacy, which is often a stumbling block for commercial solutions. 'People are often over cautious and misunderstand the risks involved, but they also need to understand how their supposedly anonymous online activities might inadvertently "fingerprint" them. It may take a few more high profile privacy controversies, like the Netflix prize lawsuit or the AOL search logs case, before users adopt healthy privacy habits', said Brickley.
Recognising that people use default settings and fail to guard personal data, the NoTube architecture builds in security to ensure linked data remains secure.
Two media, two screens, many people
NoTube also found ways of linking people viewing TV. Led by BBC R&D, the team developed methods of giving programme recommendations based on social activity and built technologies that make it easier for viewers to discuss and share TV information across their networks, whilst maintaining privacy.
This led to the development of N-screen, a web application which can help small groups decide what to watch. Users share programmes with one another in real time and change the TV channel using drag and drop - improving the experience of viewers as they watch the same programme, whilst using a second screen to interact with each other.
The project also looked at the possibility of using a smartphone as a TV remote control. 'The key aspect of N-screen or the smartphone remote is that they work by linking different data systems; their functionality is not limited by the type of device or screen used - giving more choice to consumers,' notes Brickley.
The NoTube partners were keen to other functional prototypes, such as the iFanzy service that delivers personalised and contextualised advertising and TV. It uses a range of data, including time of day, device used and viewing preferences, to serve more engaging (and therefore more successful) ads. The system also improves the delivery of audio-visual advertisements by adjusting volumes and automatically selecting the best positioning on the screen.
Another major result is the NoTube TV API which broadcasters can use to build new web-based applications and systems that make TV more interactive and 'do more'. 'The API opens up a lot of what we have developed in the project to broadcasters and media companies so they can build some of our functionality into their own platforms,' Brickley comments.
Looking to the future
'We want the user to be back in the driving seat,' says Brickley. 'NoTube can help people decide what to watch and share, record their preferences, find out more about a programme and have smarter conversations about TV programmes.'
Project partners are promoting results to the technical community; they hope that forward-thinking companies will recognise the potential impact that cross-platform and open source solutions could have. 'Much of our research output and position papers are for a fairly small group of decision-makers in the TV industry and in standards organisations,' Brickley explains. 'But we have received excellent feedback and are involved in various discussions with the W3C standards community.'
The NoTube project received EUR 6.15 million (of total EUR 9.25 million project budget) in research funding under the EU's Seventh Framework Programme (FP7).
Explore further: Launch of new P2P technology for television