Developing a neighborhood watch for the Internet

Nov 24, 2008

Internet network performance problems are not only annoying to users -- they are costly to businesses and network operators. But since the Internet has no built-in monitoring system, network problems often go unnoticed.

To help fix this problem, researchers at the McCormick School of Engineering and Applied Science at Northwestern University have developed a new way to detect and report such problems in real time through their Network Early Warning System.

While choppy playback on streaming video may be irritating to a user, it can drive thousands of potential customers away from the site providing the feed. As the Internet continues to grow, these network problems, or anomalies, become all the more frequent and frustrating.

Determining the existence, let alone the impact, of network anomalies is important because the Internet has no overall monitoring system. Current monitoring systems try to identify network anomalies and can look for issues that could lead to performance problems but cannot tell whether individual users are actually experiencing problems.

Yet every day, millions of Internet users worldwide naturally generate data traffic that inherently provides information about whether the network is working or not. (Think of the million of peer-to-peer users in systems like BitTorrent or Skype.). By sharing high-level information about their experience, these users could very efficiently and accurately detect where problems occur in real time.

So Fabián Bustamante, associate professor of electrical engineering and computer science, and doctoral student David Choffnes are exploiting this observation to build a participatory approach to detecting, isolating and reporting network anomalies: the Network Early Warning System, or NEWS for short.

"You can think of it as crowd sourcing network monitoring," said Bustamante.

While the concept behind NEWS is straightforward, Bustamante and Choffnes overcame a number of design challenges to bring the approach to an Internet-scale deployment. By gathering information about network conditions from natural data traffic, NEWS focuses only on problems that affect end-users and does so without requiring any extra and potentially wasteful network-measurement traffic. NEWS incorporates knowledge of "normal" behavior for network applications to prevent false alarms and confirms suspected problems by checking with other nearby users.

NEWS is currently implemented as an extension to a popular BitTorrent client. By generating warnings about problems in the network, the software allows users to ensure that they get the proper Internet service they pay for. This was incentive enough for more than 12,000 users to install the software during its beta-testing phase. The researchers are also developing a portal for network providers to be notified about the network problems reported by their users.

Bustamante and Choffnes, who previously released the popular Ono extension for BitTorrent (now with more than 300,000 users worldwide), are applying the NEWS approach to build other valuable services, such as enabling comparison shopping for different Internet Service Providers based on the performance seen from subscribers.

Source: Northwestern University

Explore further: FAA's Airworthiness Directive issued to avoid power loss

Related Stories

Comcast must show what's next after collapse of deal

1 hour ago

Comcast, which reports financial results on Monday, faces some tough questions about what's next for the country's biggest cable company after its dreams of a far-reaching network collapsed with the death of its $45 billion ...

Why be creative on social media?

Apr 27, 2015

There are five motivators for creating novel content online, whether blog posts, shared news stories, images, photos, songs, videos or any of the other digital artifacts users of social media and social networking sites share ...

Dipping into the cultural barriers to 'social' media

Apr 30, 2015

For the past two years, and with support from the UPLOAD project, Dr Koen Leurs has been interviewing young Londoners to generate data about how the social media generation deals with cultural differences.

Facebook rolls out video calls on Messenger

Apr 27, 2015

Facebook on Monday began rolling out video calling on its Messenger mobile application, enabling face-to-face conversations among users of the app around the world.

Recommended for you

FAA's Airworthiness Directive issued to avoid power loss

May 02, 2015

A fix for a software problem that could possibly result in power loss in Boeing 787s has been ordered. Federal Aviation Administration officials adopted a new airworthiness directive (AD), effective as of ...

Recycling aluminium, one can at a time

May 01, 2015

Producing pure aluminium from ore accounts for as much as 1 per cent of all greenhouse gas emissions worldwide. Recycling is the best way to reduce that carbon footprint – but manufacturers and recycling ...

Bringing hypersonic flight closer to reality

May 01, 2015

Two University of Sydney aeronauticalengineering PhD researchers have been invited by the European Space Agency (ESA) to help realise the dream of travelling across the globe at 7 times the speed of sound.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.