Broadband picture may not be so bleak

July 16, 2010 by Larry Hardesty, Massachusetts Institute of Technology

In March, the Federal Communications Commission released its National Broadband Plan, in which it reported that “the actual download speed experienced on broadband connections in American households is approximately 40-50% of the advertised ‘up to’ speed to which they subscribe.” That finding, which the FCC had previously cited, caused some consternation among bloggers and op-ed writers, to say nothing of broadband subscribers.

But a new study by MIT researchers calls it into question. Most of the common methods for measuring Internet data rates, the researchers conclude, underestimate the speed of the so-called access network — the part of the Internet that Internet service providers control. The number of devices accessing a home wireless network, the internal settings of a home computer, and the location of the test servers sending the computer data can all affect measurements of broadband speed.

The researchers don’t cast their findings as supporting any particular policy positions. But they do argue that everyone with an interest in the quality of broadband access — governments, service providers, subscribers, and market analysts — should be more precise about what they’re measuring and how. “If you are doing measurements, and you want to look at data to support whatever your policy position is, these are the things that you need to be careful of,” says Steve Bauer, the technical lead on the MIT Internet Traffic Analysis Study (MITAS). “For me, the point of the paper is to improve the understanding of the data that’s informing those processes.”

In addition to Bauer, the MITAS team includes William Lehr, an economist, and David Clark, a senior research scientist at the Computer Science and Artificial Intelligence Laboratory who from 1981 to 1989 was the Internet’s chief protocol architect. The researchers analyzed a half-dozen different systems for measuring the speed of Internet connections, from free applications on popular websites to commercial software licensed by most major Internet service providers (ISPs). Both MITAS and MIT’s Communications Futures Program, which also supported the study, receive funding from several major telecommunications companies.

In each case that the study examined, the underestimation of the access networks’ speed had a different cause. The study that the FCC relied upon, for instance, analyzed data for broadband subscribers with different “tiers of service”: Subscribers paid differing fees for differing data rates. But the analysts didn’t know which data corresponded to which tier of service, so they assumed that the subscription tier could be inferred from the maximum measured rate. The MITAS researchers show that, in fact, the subscribers in lower tiers sometimes ended up getting higher data rates than they had paid for. In the study cited by the FCC, exceptionally good service for a low tier may have been misclassified as exceptionally bad service for a higher tier.

In other tests, inaccurately low measurements were the result of an idiosyncrasy of the Transmission Control Protocol (TCP), the software that determines how Internet-connected computers exchange data. With TCP, the receiving computer indicates how much data it is willing to accept at any point in time; the sending computer won’t exceed that threshold. For some common computer operating systems, however, the default setting for that threshold is simply too low. 

In practice, many applications get around this constraint by opening multiple TCP connections at once. But if an Internet speed test is designed to open only one TCP connection between two computers, the computers can’t exchange nearly as much data as they would if they opened multiple connections. Their data rates end up looking artificially low.

In yet another case, Bauer was running a popular speed test on his own computer. Much of the time, he was getting rates close to those advertised by his ISP; but one afternoon, the rate fell precipitously. For days, the test had been pairing Bauer’s computer in Cambridge with a test server in New York. But on the afternoon in question, the New York server was overburdened with other requests, so it redirected Bauer to the nearest free server it could find — in Amsterdam. The long sequence of links, including a transatlantic link, between his computer and the test server probably explains the difference in data rates, Bauer says. His ISP’s access network may not have been any more congested than it had been during the previous tests.

This points to the difficulty of using a single data rate to characterize a broadband network’s performance, another topic the MITAS researchers address in their paper. “What is it that people care about if they want to compare a metric of merit?” Lehr asks. “If you’re watching lots of movies, you’re concerned about how much data you can transfer in a month and that your connection goes fast enough to keep up with the movie for a couple hours. If you’re playing a game, you care about transferring small amounts of traffic very quickly. Those two kinds of users need different ways of measuring a network.”

The researchers have submitted their report to both the FCC and the Federal Trade Commission and will present a version of it at the Telecommunications, Policy, and Research Conference in Arlington, Va., in October. “This report from Dave, Steve Bauer, and Bill Lehr is the first comparative study that I’ve seen,” says FCC spokesman Walter Johnson. As Johnson points out — and the MITAS researchers acknowledge in their paper — the FCC is currently in the early stages of a new study that will measure broadband speeds in 10,000 homes, using dedicated hardware that bypasses problems like TCP settings or the limited capacity of home wireless networks. “What we’re doing right now," Johnson says, “is a follow-up to the broadband plan, recognizing that we need better data.”

Explore further: FCC plans study to measure broadband speeds

Related Stories

FCC plans study to measure broadband speeds

June 1, 2010

(AP) -- The Federal Communications Commission wants to find out whether broadband providers are delivering Internet connections that are as fast as advertised.

FCC gets going on national broadband plan

April 8, 2009

(AP) -- The Federal Communications Commission took the first step Wednesday in developing a comprehensive plan to give all Americans high-speed Internet access.

FCC survey shows need to teach broadband basics

February 23, 2010

(AP) -- The government's plan to provide fast Internet connections to all Americans will have to include some basic instruction in Web 101, according to a new survey of Internet users and non-users.

FCC plans to move forward with broadband plan soon

April 8, 2010

(AP) -- The Federal Communications Commission said Thursday that it intends to move forward quickly with key recommendations in its national broadband plan - even though a federal appeals court this week undermined the agency's ...

FCC offers early peak at national broadband plan

December 16, 2009

(AP) -- Expanding the fund that subsidizes telephone service for poor and rural communities and finding more spectrum for wireless broadband services will be key pieces of a federal plan to bring high-speed Internet connections ...

Recommended for you

Researchers make coldest quantum gas of molecules

February 21, 2019

JILA researchers have made a long-lived, record-cold gas of molecules that follow the wave patterns of quantum mechanics instead of the strictly particle nature of ordinary classical physics. The creation of this gas boosts ...

Quantum dots can spit out clone-like photons

February 21, 2019

In the global quest to develop practical computing and communications devices based on the principles of quantum physics, one potentially useful component has proved elusive: a source of individual particles of light with ...


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Jul 16, 2010
My network is rated at 6mb, the VERY most I can download a second is 1mb from multiple connections & servers.

Although whenever I do a speed test I get a BS report of 16mb a second, this has no real standing on actual use speeds.
5 / 5 (2) Jul 16, 2010
I think you are confusing Mb/s and MB/s.

The download speed when downloading a file is in MB/s and the download speed advertised by your ISP is in Mb/s. If you are able to download at 1 MB/s, you are getting 8Mb/s throughput.
not rated yet Jul 16, 2010
Tests certainly do not match real download speeds. I pay for 1 Mbps, test at 0.8 and am really lucky to see 25 KBps on the download side. Can't even stream audio real-time.
not rated yet Jul 16, 2010
My ISP is advertised as 3.5Mb/s. But the download speed is approx. 312kb/s. Upload is a sorry 42kb/s.
5 / 5 (1) Jul 16, 2010
I think you are confusing Mb/s and MB/s.

The download speed when downloading a file is in MB/s and the download speed advertised by your ISP is in Mb/s. If you are able to download at 1 MB/s, you are getting 8Mb/s throughput.

Closer to 10Mb due to packet tagging and other TCP overhead, but just about accurate.
5 / 5 (1) Jul 16, 2010
It is important not to confuse kilobits (kb) and kilobytes (kB). Both are often used.

1 kB = 8 kb

I have 3.5 mb/s connection, and my real download is about 400 kB/s, which is 3.2 mb/s.
5 / 5 (2) Jul 16, 2010
It is important not to confuse kilobits (kb) and kilobytes (kB). Both are often used.

Things also depend on if you're a mac user, because according to Steve Jobs, a "kilo" in bits or bytes means 1000 and not 1024, despite the fact that bits and bytes are not SI units and they don't have to follow the convention.

So, if you're using a mac to measure your connection speed mind that 2.4% error, or 4.8% error if you're talking about megabytes. When counting gigabytes, a mac would seem almost 10% faster than an ordinary pc merely due to the fact that it counts wrong.
not rated yet Jul 17, 2010
Steve Jobs is so flashy!
His computer gets one K per 1000 bytes downloaded and his phone has an extra bar of connection strength!
not rated yet Jul 18, 2010
verizon fios coming in at 9.2 Mb/s. Advertised as 15 Mb/s.
Jul 18, 2010
This comment has been removed by a moderator.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.