How natural disasters and political unrest affect the Internet

Apr 04, 2011

In the wake of the recent earthquake and tsunami in Japan, as well as political unrest in Egypt and Libya, researchers at Northwestern University are analyzing data that provides unique insight into the effects of these crises on the Internet.

Using data from approximately 1.4 million users of Ono and NEWS, software programs developed by the AquaLab research group of Fabián E. Bustamante, associate professor of electrical engineering and computer science at the McCormick School of Engineering, researchers can get a glimpse of Internet traffic from the user perspective.

"Often people look at Internet traffic from either the network itself, at network routers, or from large Internet services, to see how a crisis might have affected Internet activity," Bustamante explains. "By using data from users of our software and collaborators, we're able to see beyond firewalls and NATs (Network Address Translators) and capture the view from the very edge of the network – the users themselves."

By analyzing the data, the team found how users in Japan only showed reduced activity within the 24 hours after the earthquake. In the case of both Libya and , which have been subject to Internet shutdowns, the events can be clearly seen in sudden drops in the number of online users.

The software of Bustamante's group can also identify effects of network throttling, a practice of limiting the rate of data transfer to control congestion. Virgin Media, a large Internet service provider in the United Kingdom, recently completed a test of its new throttling policy, targeting peer-to-peer users. The user data showed that the policy had a dramatic effect on its users, at times cutting their upload capacity in half.

About Ono and NEWS

Ono (Hawaiian for "delicious") and NEWS (Network Early Warning System), are two of the software pieces developed in the AquaLab group, led by Bustamante.

Both are extensions to the popular BitTorrent peer-to-peer system. Ono addresses the tension between Internet Service Providers and some of their customers who use P2P services. The growing network traffic credited to P2P has driven service providers to forcefully reduce user services traffic at the expense of unhappy subscribers and the risk of government investigations.

Ono helps BitTorrent peers find other peers that are nearby, in a networking sense, by reusing the network "view" of other large-scale services such as content distribution networks (CDN) like Akamai and Limelight. CDN services redistribute content from popular websites on their servers around the world and redirect clients to nearby copies based on network conditions. Using the key assumption that two computers sent to the same CDN server are likely close to each other, Ono allows P2P users to quickly identify nearby users. Bustamante and his group have shown that Ono can provide over 30 percent average download rate improvement and, in environments with large available bandwidth, a 200 percent increase in download rates.

NEWS relies on peer-to-peer users to help detect and report Internet network performance problems. Because choppy playback on streaming video may be irritating to a user, such issues can drive thousands of potential customers away from the site providing the feed. As the Internet continues to grow, these network problems, or anomalies, become all the more frequent and frustrating. Determining the existence, let alone the impact, of network anomalies is important because the Internet has no overall monitoring system. Current monitoring systems try to identify network anomalies and can look for issues that could lead to performance problems but cannot tell whether individual users are actually experiencing problems.

Every day, millions of users worldwide naturally generate data traffic that inherently provides information about whether the network is working or not. (Think of the millions of peer-to-peer users in systems like BitTorrent or Skype.). By sharing high-level information about their experience, these users could very efficiently and accurately detect where problems occur in real time. "You can think of it as crowd-sourcing monitoring," says Bustamante.

Explore further: Google Baseline Study aims to define what a healthy human looks like

More information: A more detailed analysis is available at http://www.aqualab.cs.northwestern.edu/blog/

add to favorites email to friend print save as pdf

Related Stories

Software improves p2p privacy by hiding in the crowd

Apr 08, 2009

Researchers at the McCormick School of Engineering and Applied Science at Northwestern University have identified a new "guilt-by-association" threat to privacy in peer-to-peer (P2P) systems that would enable an eavesdropper ...

F-Secure buys out ROMmon

Nov 30, 2005

F-Secure launched Wednesday a new system to protect Internet service providers from network abuse by buying out ROMmon.

Small Telephone Network With Peer-to-Peer

Apr 07, 2006

Siemens has developed a telephone system that doesn't require a switchboard. The HiPath BizIP telephones are directly connected to one another and communicate much like participants in an Internet file-sharing ...

Peer-to-peer heart monitoring

Mar 09, 2009

The possibility of remote monitoring for chronically ill patients will soon become a reality. Now, researchers in South Africa and Australia have devised a decentralized system to avoid medical data overload. They describe ...

P2P traffic control

Jan 07, 2009

Could a concept from information technology familiar to online file sharers be exploited to reduce road congestion and even traffic accidents? That is the question answered in the affirmative by researchers in California, ...

Recommended for you

Study shows role of media in sharing life events

18 hours ago

To share is human. And the means to share personal news—good and bad—have exploded over the last decade, particularly social media and texting. But until now, all research about what is known as "social sharing," or the ...

UK: Former reporter sentenced for phone hacking

Jul 24, 2014

(AP)—A former British tabloid reporter was given a 10-month suspended prison sentence Thursday for his role in the long-running phone hacking scandal that shook Rupert Murdoch's media empire.

Evaluating system security by analyzing spam volume

Jul 24, 2014

The Center for Research on Electronic Commerce (CREC) at The University of Texas at Austin is working to protect consumer data by using a company's spam volume to evaluate its security vulnerability through the SpamRankings.net ...

Surveillance a part of everyday life

Jul 24, 2014

Details of casual conversations and a comprehensive store of 'deleted' information were just some of what Victoria University of Wellington students found during a project to uncover what records companies ...

User comments : 0