# Complete Internet census taken -- perhaps the first since 1982

##### Oct 09, 2007

Researchers at the University of Southern California Information Sciences Institute, one of the birthplaces of the Internet decades ago, have just completed and plotted a comprehensive census of all of the more 2.8 million allocated addresses on the Internet -- the first complete effort of its kind in more than two decades, they say.

"An Internet Census," explains John Heidemannn, an ISI project leader who also has an appointment in the USC Viterbi School of Engineering computer science department, "is just that: every single assigned address in the entire Internet was sent a probe."

The technical name for an Internet probe, more commonly called a "ping" is an "Internet Control Message Protocol (ICMP) echo request packet." It took some 62 days to send almost 3 billion of these from three machines, an effort carried out by Heidmann's ISI collaborator Yuri Pradkin.

A detailed account of the research is at www.isi.edu/ant/address/index.html>

Many (61 percent) of the pings received no response at all. Many others got a "do not disturb" or "no information available" response that many network adminstrators program into their routers and firewalls. Some of the non- replies were probably also due to firewalls intentionally blocking the pings. Still, as the census went on, millions of sites did respond, positively and negatively, and a unique internet atlas took shape.

The atlas is not geographic, though geographic areas (North American, Europe, etc) show up on it. Instead, it is numerical, building on the mathematical structure of the Internet address system.

Each internet address is a number between 0 and 2 to the 32nd power (4,294,967,295), usually written in "dotted-decimal notation" as four base-10 numbers separated by periods; for example 128.150.4.107. Each number represents one 8-bit part of the whole address.

These addresses appear in the chart as a grid of squares, each square representing all the addresses beginning with the same first number ("128," in the preceding example). The map is arranged in ascending numerical order, but instead in a looping pattern called a Hilbert curve, which keeps adjacent addresses physically near each other, on chart," but also makes it possible to zoom seamlessly in to show greater detail. "The idea of using a Hilbert curve actually came from a web comic, xkcd," Heidemann said.

The smallest feature the map shows is a singe pixel, which is records averaged responses from some 65,536 (2 to the 16th) addresses. The averaging is conveyed by color coding, with all positive responses showing up as brilliant green, all negative as brilliant red, equal numbers as brilliant yellow, with brilliance decreasing down to dim shades in areas where fewer addresses respond.

But the map presents a census view of the visible Internet. "To our knowledge," said Heidemann," the only other census of the Internet was in 1982," when the Intenet consisted of 315 allocated addresses.

Heidemannn and Pradkin have also plotted a second rendering where each pixel represents a single address. When printed out at laser-printer resolution, this map that literally shows every address in the Internet takes up a 9x9 foot space on a corridor wall in ISI's Marina del Rey campus.

The project is continuing. Heidemann hopes to continue censuses to create not just a snapshot -which is what the current map is - but a dynamic movie of Internet evolution, which can aid in detecting and monitoring trends. He and his collaborators are intensively studying the census results working toward this goal.

While the new census is the first they have visualized. ISI has been taking censuses since 2003, when Praydkin and Joseph Bannister (of ISI) and Ramesh Govindan (of the USC Viterbi School of Engineering, started collecting data. Their hopes were to study the growth of the Internet, and their group is still processing this data to look for trends.

“Internet census data is useful for several reasons”, Heidemannn says. “As the Internet use becomes widespread, we are running out of Internet addresses—good predictions by Geoff Huston suggest all addresses may be allocated as soon as early 2010. The IETF (Internet Engineering Task Force, the technical body that manages the Internet) has anticipated this since the 1990s and designed a new protocol, IPv6, to solve this problem, but deployment has been slow. Our data can help illustrate the need to move forward.”

The census also can improve Internet security. In fact, says Heidemann, the Department of Homeland Security "supported our work with the goal of improving network security," As one example, ISI research Jelena Mirkovicis using the new census data to study how worms spread in the Internet. Other researchers have plotted maps of where cyber-attacks originate.

"There’s also a sense of discovery in these maps," Heidemannn says. "We’ve built a huge Internet and use it every day. Like the far side of the moon, wouldn’t you like to know what it looks like"'

Source: University of Southern California

## Related Stories

#### IT industry ignores silver surfers at its peril

May 14, 2013

Hardware and software vendors are foolish to ignore the needs of the growing population of older computer and information technology users, the so-called "silver surfers". US researchers offer convincing evidence in a monograph ...

#### Social media power youth political participation

Jun 26, 2012

The MacArthur Research Network on Youth and Participatory Politics (YPP), under the direction of co-principal investigators University of Chicago political scientist Cathy Cohen, and Joseph Kahne, professor of education at ...

#### In tech first, US puts entire 1940 census online

Apr 02, 2012

The National Archives opened a treasure trove to genealogists and historians on Monday, releasing the 1940 national census in its entirety -- and doing so for the first time online.

#### US residents say Hawaii's coral reef ecosystems worth \$33.57 billion per year

Oct 21, 2011

A peer-reviewed study commissioned by NOAA shows the American people assign an estimated total economic value of \$33.57 billion for the coral reefs of the main Hawaiian Islands.

#### British teen arrested over CIA, US Senate hacking

Jun 21, 2011

British police working with the FBI arrested a 19-year-old man over attacks by a hacker group on businesses and government agencies including the CIA, US Senate and Sony, Scotland Yard said Tuesday.

#### Gov't says up to 10 pct in US lack good Internet

Feb 17, 2011

(AP) -- As many as one in 10 Americans can't get Internet connections that are fast enough for common tasks such as viewing photos, video and Web pages, and two thirds of schools have broadband connections that are too slow ...

## Recommended for you

14 hours ago

(Phys.org) —Google engineers working on software to automatically read home and business addresses off photographs taken by Street View vehicles, have created a product so good that not only can it be used ...

#### Preventing AI from developing anti-social and potentially harmful behaviour

14 hours ago

Next time you play a computer at chess, think about the implications if you beat it. It could be a very sore loser!

#### Researcher seeks to lessen failures in computerized visual recognition programs

14 hours ago

Computer programs that use facial or image recognition systems—be it security cameras or applications that search databases for everything from photographs of wanted criminals to images of bears – are like any other technological ...

#### Neuromorphic computing 'roadmap' envisions analog path to simulating human brain

16 hours ago

(Phys.org) —In the field of neuromorphic engineering, researchers study computing techniques that could someday mimic human cognition. Electrical engineers at the Georgia Institute of Technology recently ...

#### Computer software accurately predicts student test performance

Apr 16, 2014

Emotient, the leading provider of facial expression recognition data and analysis, and the University of California, San Diego announced publication of a joint study by two Emotient co-founders affiliated ...

#### Ant colonies help evacuees in disaster zones

Apr 16, 2014

An escape route mapping system based on the behavior of ant colonies could give evacuees a better chance of reaching safe harbor after a natural disaster or terrorist attack by building a map of showing the shortest routes ...

## More news stories

#### Hackathon team's GoogolPlex gives Siri extra powers

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

(Phys.org) —Google engineers working on software to automatically read home and business addresses off photographs taken by Street View vehicles, have created a product so good that not only can it be used ...

#### Tiny power plants hold promise for nuclear energy (Update)

Small underground nuclear power plants that could be cheaper to build than their behemoth counterparts may herald the future for an energy industry under intense scrutiny since the Fukushima disaster, the ...

#### Neuromorphic computing 'roadmap' envisions analog path to simulating human brain

(Phys.org) —In the field of neuromorphic engineering, researchers study computing techniques that could someday mimic human cognition. Electrical engineers at the Georgia Institute of Technology recently ...

#### Satellite telecom vulnerable to hackers, researchers find

Security flaws in many satellite telecommunications systems leave them open to hackers, raising potential risks for aviation, shipping, military and other sectors, security researchers said Thursday.

#### First potentially habitable Earth-sized planet confirmed: It may have liquid water

The first Earth-sized exoplanet orbiting within the habitable zone of another star has been confirmed by observations with both the W. M. Keck Observatory and the Gemini Observatory. The initial discovery, ...

#### Vitamin B3 might have been made in space, delivered to Earth by meteorites

Ancient Earth might have had an extraterrestrial supply of vitamin B3 delivered by carbon-rich meteorites, according to a new analysis by NASA-funded researchers. The result supports a theory that the origin ...

#### Better thermal-imaging lens from waste sulfur

Sulfur left over from refining fossil fuels can be transformed into cheap, lightweight, plastic lenses for infrared devices, including night-vision goggles, a University of Arizona-led international team ...

#### Bright points in Sun's atmosphere mark patterns deep in its interior

Like a balloon bobbing along in the air while tied to a child's hand, a tracer has been found in the sun's atmosphere to help track the flow of material coursing underneath the sun's surface.

#### Deadly human pathogen Cryptococcus fully sequenced

Within each strand of DNA lies the blueprint for building an organism, along with the keys to its evolution and survival. These genetic instructions can give valuable insight into why pathogens like Cryptococcus ne ...