Developing a neighborhood watch for the Internet

Nov 24, 2008

Internet network performance problems are not only annoying to users -- they are costly to businesses and network operators. But since the Internet has no built-in monitoring system, network problems often go unnoticed.

To help fix this problem, researchers at the McCormick School of Engineering and Applied Science at Northwestern University have developed a new way to detect and report such problems in real time through their Network Early Warning System.

While choppy playback on streaming video may be irritating to a user, it can drive thousands of potential customers away from the site providing the feed. As the Internet continues to grow, these network problems, or anomalies, become all the more frequent and frustrating.

Determining the existence, let alone the impact, of network anomalies is important because the Internet has no overall monitoring system. Current monitoring systems try to identify network anomalies and can look for issues that could lead to performance problems but cannot tell whether individual users are actually experiencing problems.

Yet every day, millions of Internet users worldwide naturally generate data traffic that inherently provides information about whether the network is working or not. (Think of the million of peer-to-peer users in systems like BitTorrent or Skype.). By sharing high-level information about their experience, these users could very efficiently and accurately detect where problems occur in real time.

So Fabián Bustamante, associate professor of electrical engineering and computer science, and doctoral student David Choffnes are exploiting this observation to build a participatory approach to detecting, isolating and reporting network anomalies: the Network Early Warning System, or NEWS for short.

"You can think of it as crowd sourcing network monitoring," said Bustamante.

While the concept behind NEWS is straightforward, Bustamante and Choffnes overcame a number of design challenges to bring the approach to an Internet-scale deployment. By gathering information about network conditions from natural data traffic, NEWS focuses only on problems that affect end-users and does so without requiring any extra and potentially wasteful network-measurement traffic. NEWS incorporates knowledge of "normal" behavior for network applications to prevent false alarms and confirms suspected problems by checking with other nearby users.

NEWS is currently implemented as an extension to a popular BitTorrent client. By generating warnings about problems in the network, the software allows users to ensure that they get the proper Internet service they pay for. This was incentive enough for more than 12,000 users to install the software during its beta-testing phase. The researchers are also developing a portal for network providers to be notified about the network problems reported by their users.

Bustamante and Choffnes, who previously released the popular Ono extension for BitTorrent (now with more than 300,000 users worldwide), are applying the NEWS approach to build other valuable services, such as enabling comparison shopping for different Internet Service Providers based on the performance seen from subscribers.

Source: Northwestern University

Explore further: Drone postal deliveries begin in Switzerland

Related Stories

Algorithm detects nudity in images, offers demo page

18 hours ago

An algorithm has been designed to tell if somebody in a color photo is naked. Isitnude.com launched earlier this month; its demo page invites you to try it out to test its power in nudity detection. You ...

Collaboratively exploring virtual worlds

Jun 30, 2015

Today's students are accustomed to highly stimulating and interactive content, whether in the form of video games or mobile apps. As a result, they respond to a higher level of interactivity and engagement ...

Most internet anonymity software leaks users' details

Jun 29, 2015

Virtual Private Networks (VPNs) are legal and increasingly popular for individuals wanting to circumvent censorship, avoid mass surveillance or access geographically limited services like Netflix and BBC ...

I always feel like somebody's watching me…

Jun 25, 2015

What power can individuals have over their data when their every move online is being tracked? Researchers at the Cambridge Computer Laboratory are building new systems that shift the power back to individual ...

Recommended for you

Drone postal deliveries begin in Switzerland

10 hours ago

Wondering where your package is? Look up! Switzerland's postal service said Tuesday it had begun testing parcel deliveries by unmanned drones, although widespread use of the flying postmen is not likely to kick in for another ...

Omnidirectional free space wireless charging developed

10 hours ago

Mobile devices, such as smartphones and laptops, have become indispensable portable items in modern life, but one big challenge remains to fully enjoying these devices: keeping their batteries charged.

Europe's deepest glider to be developed

Jul 06, 2015

19 partners from across Europe have come together to develop Europe's first ultra-deep-sea robot glider. This glider will be capable of sampling the ocean autonomously at depths of 5000m, and maybe more in ...

Researchers help reconstructing the Michelangelo bronzes

Jul 06, 2015

Engineers and imagers from the University of Warwick's Warwick Manufacturing Group (WMG) and anatomists from Warwick Medical School at the University of Warwick are helping Art historians from the University ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.