Syncing data center computers at the speed of light

December 16, 2016 by Bill Steele, Cornell University

When several computers need to work together, as when calculating in parallel on several parts of a single large problem or managing a large database, they need to keep in step. These situations are particularly common in large data centers that make up "the cloud" where institutions farm out their computing needs. So a Cornell computer scientist has come up with a new system, "Datacenter Time Protocol" (DTP), in which signals sent at the speed of light over fiber-optic cables between the computers enable them to stay in sync to within a few nanoseconds.

"Time is important," said Hakim Weatherspoon, professor of computer science. "The closer you can synchronize clocks, the higher performance your systems can achieve." For the corporate or individual user this can mean cloud computing efficiency, faster search engines and speedier apps on a mobile phone.

Weatherspoon was on sabbatical during fall 2015 at Microsoft Research, working with Microsoft researchers Hitesh Ballani and Paolo Costa in their Rack-Scale Computing group. They have continued their collaboration since Weatherspoon's return to Cornell.

"Rack-scale computing" refers to the latest step forward in cloud centers: Beyond linking arrays of individual servers, the systems link racks that hold several computers each. A "switch" on each rack keeps the computers on the rack working together and connects the rack to the rest of the center.

Weatherspoon and doctoral students Ki Suh Lee, Han Wang and Vishal Shrivaslav presented the research in a paper, "Globally Synchronized Time via Datacenter Networks," at the ACM Special Interest Group on Data Communication conference in Florianópolis, Brazil, in August.

The central processing unit in a computer generates a "clock signal" – a steady beat that tells the rest of the chip when to move forward a step in its program, like a drummer keeping a marching band together. Even if all the CPUs in a data center are the same model from the same manufacturer, differences in temperature, power supply or load can cause some of them to run at different rates. The goal is for each computer to recognize the "offset" between itself and another to which it is linked, and adjust the timing of its messages to the other accordingly.

DTP works behind the scenes at the "physical level" of a network. On Ethernet networks, data ordinarily travel in "packets" – strings of ones and zeros marked with a beginning and an end and containing a destination address and a payload of information. DTP sends computers information about their time difference by directly modifying the pulses of light that travel through , with no effect on the higher level packets.

Upgrading a data center to use the system would not be expensive, the researchers said, although the hardware that connects computers to the network would have to be modified to read and write the DTP signals. Weatherspoon is hoping for the addition of a DTP standard to the IEEE standards for Ethernet networks.

In tests at a Microsoft , DTP kept computers in sync to within 25.6 nanoseconds. "We scheduled every packet from every machine in a rack-scale system, resulting in reduced power, cost and size of the network fabric," said Weatherspoon. "They are very interested in this technology."

Explore further: Cornell collaboration with IBM to speed up 'the cloud'

Related Stories

Cornell collaboration with IBM to speed up 'the cloud'

March 16, 2010

( -- More and more of today's computing is happening in "the cloud" -- not just on the desktop or even on the big servers in the basement but all over the Net at once. Government agencies, banks and companies ...

Wireless data centers could be faster, cheaper, greener

September 27, 2012

(—Cornell computer scientists have proposed an innovative wireless design that could greatly reduce the cost and power consumption of massive cloud computing data centers, while improving performance.

Making a covert channel on the Internet

June 4, 2014

( —The best way to keep a message secret is not just to encrypt it, but to hide the fact that the message is even there. Computer scientists have created "covert channels" on the Internet, but they have been slow ...

Researchers work to take the errors out of the cloud

October 14, 2011

Cloud computing, which taps the resources of a network of remote computers, offers tremendous potential for storing and processing vast amounts of data quickly and cheaply. The catch: As cloud computing applications become ...

Are racks-on-chip the future of data centers?

November 5, 2013

( —Increasing the scale and decreasing the cost and power of data centers requires greatly boosting the density of computing, storage and networking within those centers. That is the hard truth spelled out in the ...

Data traffic system switches control to network administrators

November 3, 2016

Torrents of information flow through computer data centers, driving the operations of financial markets, communications systems, commerce and just about any complex web-based activity. Much of modern society is built on these ...

Recommended for you

Technology near for real-time TV political fact checks

January 18, 2019

A Duke University team expects to have a product available for election year that will allow television networks to offer real-time fact checks onscreen when a politician makes a questionable claim during a speech or debate.

Privacy becomes a selling point at tech show

January 7, 2019

Apple is not among the exhibitors at the 2019 Consumer Electronics Show, but that didn't prevent the iPhone maker from sending a message to attendees on a large billboard.

China's Huawei unveils chip for global big data market

January 7, 2019

Huawei Technologies Ltd. showed off a new processor chip for data centers and cloud computing Monday, expanding into new and growing markets despite Western warnings the company might be a security risk.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.