Syncing data center computers at the speed of light

December 16, 2016 by Bill Steele

When several computers need to work together, as when calculating in parallel on several parts of a single large problem or managing a large database, they need to keep in step. These situations are particularly common in large data centers that make up "the cloud" where institutions farm out their computing needs. So a Cornell computer scientist has come up with a new system, "Datacenter Time Protocol" (DTP), in which signals sent at the speed of light over fiber-optic cables between the computers enable them to stay in sync to within a few nanoseconds.

"Time is important," said Hakim Weatherspoon, professor of computer science. "The closer you can synchronize clocks, the higher performance your systems can achieve." For the corporate or individual user this can mean cloud computing efficiency, faster search engines and speedier apps on a mobile phone.

Weatherspoon was on sabbatical during fall 2015 at Microsoft Research, working with Microsoft researchers Hitesh Ballani and Paolo Costa in their Rack-Scale Computing group. They have continued their collaboration since Weatherspoon's return to Cornell.

"Rack-scale computing" refers to the latest step forward in cloud centers: Beyond linking arrays of individual servers, the systems link racks that hold several computers each. A "switch" on each rack keeps the computers on the rack working together and connects the rack to the rest of the center.

Weatherspoon and doctoral students Ki Suh Lee, Han Wang and Vishal Shrivaslav presented the research in a paper, "Globally Synchronized Time via Datacenter Networks," at the ACM Special Interest Group on Data Communication conference in Florianópolis, Brazil, in August.

The central processing unit in a computer generates a "clock signal" – a steady beat that tells the rest of the chip when to move forward a step in its program, like a drummer keeping a marching band together. Even if all the CPUs in a data center are the same model from the same manufacturer, differences in temperature, power supply or load can cause some of them to run at different rates. The goal is for each computer to recognize the "offset" between itself and another to which it is linked, and adjust the timing of its messages to the other accordingly.

DTP works behind the scenes at the "physical level" of a network. On Ethernet networks, data ordinarily travel in "packets" – strings of ones and zeros marked with a beginning and an end and containing a destination address and a payload of information. DTP sends computers information about their time difference by directly modifying the pulses of light that travel through , with no effect on the higher level packets.

Upgrading a data center to use the system would not be expensive, the researchers said, although the hardware that connects computers to the network would have to be modified to read and write the DTP signals. Weatherspoon is hoping for the addition of a DTP standard to the IEEE standards for Ethernet networks.

In tests at a Microsoft , DTP kept computers in sync to within 25.6 nanoseconds. "We scheduled every packet from every machine in a rack-scale system, resulting in reduced power, cost and size of the network fabric," said Weatherspoon. "They are very interested in this technology."

Explore further: Cornell collaboration with IBM to speed up 'the cloud'

Related Stories

Cornell collaboration with IBM to speed up 'the cloud'

March 16, 2010

(PhysOrg.com) -- More and more of today's computing is happening in "the cloud" -- not just on the desktop or even on the big servers in the basement but all over the Net at once. Government agencies, banks and companies ...

Wireless data centers could be faster, cheaper, greener

September 27, 2012

(Phys.org)—Cornell computer scientists have proposed an innovative wireless design that could greatly reduce the cost and power consumption of massive cloud computing data centers, while improving performance.

Making a covert channel on the Internet

June 4, 2014

(Phys.org) —The best way to keep a message secret is not just to encrypt it, but to hide the fact that the message is even there. Computer scientists have created "covert channels" on the Internet, but they have been slow ...

Researchers work to take the errors out of the cloud

October 14, 2011

Cloud computing, which taps the resources of a network of remote computers, offers tremendous potential for storing and processing vast amounts of data quickly and cheaply. The catch: As cloud computing applications become ...

Are racks-on-chip the future of data centers?

November 5, 2013

(Phys.org) —Increasing the scale and decreasing the cost and power of data centers requires greatly boosting the density of computing, storage and networking within those centers. That is the hard truth spelled out in the ...

Data traffic system switches control to network administrators

November 3, 2016

Torrents of information flow through computer data centers, driving the operations of financial markets, communications systems, commerce and just about any complex web-based activity. Much of modern society is built on these ...

Recommended for you

The wet road to fast and stable batteries

December 14, 2017

An international team of scientists—including several researchers from the U.S. Department of Energy's (DOE) Argonne National Laboratory—has discovered an anode battery material with superfast charging and stable operation ...

US faces moment of truth on 'net neutrality'

December 14, 2017

The acrimonious battle over "net neutrality" in America comes to a head Thursday with a US agency set to vote to roll back rules enacted two years earlier aimed at preventing a "two-speed" internet.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.