First large-scale study quantitatively demonstrates how video stream quality causes changes in viewer behavior

November 13, 2012
This shows Ramesh Sitaraman. Credit: UMass Amherst

It may seem like common sense that the quality of online video streaming affects how willing viewers are to watch videos at a website. But until computer science researcher Ramesh Sitaraman at the University of Massachusetts Amherst and collaborators at Akamai developed a way to rigorously study the question, no one had been able to scientifically test the assumption.

They conducted the first large-scale study of its kind to quantitatively demonstrate how video stream quality causes changes in viewer behavior. "Video stream quality is a very big topic of interest," says Sitaraman. "Anyone who provides online , from the major news channels to sports and movie outlets, is worried about such things as do videos fail, how fast a video starts up, does it freeze, and how such loss of quality affects viewers."

"You want viewers to not abandon your content. You want them to watch longer, and return to your site often to watch more videos, resulting in more opportunities to show ads and to increase your subscriber base. The link between video streaming quality and viewer behavior has long been recognized as hugely important, but we couldn't study it with any scientific precision until now."

"The ability to collect large amounts of relevant data, plus new techniques we developed for the analysis were the game changers," says Sitaraman, who is also an Akamai Fellow. More than a dozen years ago, he helped build the Akamai network and helped pioneer content delivery now used to stream a large fraction of the online videos on the Internet today.

This week in Boston, he presents research done in collaboration with S. Shunmuga Krishnan at the Association for Computing Machinery (ACM) Internet Measurement Conference in a talk titled, " Quality Impacts Viewer Behavior: Inferring Causality using Quasi-Experimental Designs."

They report that viewers begin to abandon if the video does not start up within two seconds. Beyond two seconds, every additional one-second delay resulted in roughly a 5.8 percent increase in the abandonment rate. They also found that viewers are less tolerant of startup delay for short videos such as news clips compared to longer ones such as movies. Also of interest is that viewers with better connectivity are less patient and will abandon a slow-starting video sooner, while mobile users have significantly more patience than others.

Sitaraman also says viewers watch fewer minutes of the video if the video "freezes" while playing. A typical viewer whose video froze for 1 percent of its duration watched for 5 percent fewer minutes than a similar viewer whose video played smoothly without freezes. Further, viewers who experienced failures were less likely to return to the same web site to play more videos. A typical viewer who left the site after failing to play a video was 2.3 percent less likely to return to the same site within the week compared to a similar viewer who experienced no failures.

This study analyzes an unprecedented 6.7 million unique viewers from around the world who in aggregate watched 23 million videos for 216 million minutes over a period of ten days. To conduct this research, Sitaraman and colleagues used a method more familiar to medical and social science research than to computer systems research. Through the collaboration with Akamai that currently delivers 15 to 30 percent of global web traffic, the researchers had access to millions of anonymous traces that contain information of how users watch videos and the quality they experienced.

To assess the impact of video quality on viewer behavior, the researchers assigned viewers to one of two "treatment" groups. One had a good quality video viewing experience while the other group experienced poor quality such as video failure to launch, delayed start or repeated freezing.

A viewer in a good quality group was then randomly matched with a viewer in the poor quality group so viewers were matched as closely as possible on geography, connection type, content and other characteristics of interest. Thus viewers in each pair differ on the quality of experience but are similar in other regards. "By comparing the difference in behavior of the paired viewers for hundreds of thousands of pairs, we are able to better isolate the impact of quality alone and exclude other confounding factors," says Sitaraman.

He adds, "A scientific understanding of the causal impact of streaming quality on viewers is a key piece of the puzzle for the success of online media. It helps computer scientists build better-distributed networks that deliver videos with higher user-perceived . It also helps video content providers better understand their users and the opportunities for monetization. Research in this area is particularly important now as even traditional media like television are migrating quickly to the Internet."

Explore further: YouTube topped 100 million US viewer mark in January: comScore

Related Stories

YouTube adds online video editing tool

June 17, 2010

YouTube users can now edit their own videos online. The Google-owned video-sharing site added an online editing tool this week that allows YouTube users to combine multiple videos, shorten a video or add soundtracks from ...

YouTube 'Town Hall' takes US political pulse

May 18, 2011

YouTube on Wednesday launched a "Town Hall" website at which US congressional leaders address issues in brief videos and viewers get to show which positions they support.

Recommended for you

Inferring urban travel patterns from cellphone data

August 29, 2016

In making decisions about infrastructure development and resource allocation, city planners rely on models of how people move through their cities, on foot, in cars, and on public transportation. Those models are largely ...

How machine learning can help with voice disorders

August 29, 2016

There's no human instinct more basic than speech, and yet, for many people, talking can be taxing. 1 in 14 working-age Americans suffer from voice disorders that are often associated with abnormal vocal behaviors - some of ...

Apple issues update after cyber weapon captured

August 26, 2016

Apple iPhone owners on Friday were urged to install a quickly released security update after a sophisticated attack on an Emirati dissident exposed vulnerabilities targeted by cyber arms dealers.

Auto, aerospace industries warm to 3D printing

August 25, 2016

New 3D printing technology unveiled this week sharply increases the size of objects that can be produced, offering new possibilities to remake manufacturing in the auto, aerospace and other major industries.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.