Syncing data center computers at the speed of light

December 16, 2016 by Bill Steele, Cornell University

When several computers need to work together, as when calculating in parallel on several parts of a single large problem or managing a large database, they need to keep in step. These situations are particularly common in large data centers that make up "the cloud" where institutions farm out their computing needs. So a Cornell computer scientist has come up with a new system, "Datacenter Time Protocol" (DTP), in which signals sent at the speed of light over fiber-optic cables between the computers enable them to stay in sync to within a few nanoseconds.

"Time is important," said Hakim Weatherspoon, professor of computer science. "The closer you can synchronize clocks, the higher performance your systems can achieve." For the corporate or individual user this can mean cloud computing efficiency, faster search engines and speedier apps on a mobile phone.

Weatherspoon was on sabbatical during fall 2015 at Microsoft Research, working with Microsoft researchers Hitesh Ballani and Paolo Costa in their Rack-Scale Computing group. They have continued their collaboration since Weatherspoon's return to Cornell.

"Rack-scale computing" refers to the latest step forward in cloud centers: Beyond linking arrays of individual servers, the systems link racks that hold several computers each. A "switch" on each rack keeps the computers on the rack working together and connects the rack to the rest of the center.

Weatherspoon and doctoral students Ki Suh Lee, Han Wang and Vishal Shrivaslav presented the research in a paper, "Globally Synchronized Time via Datacenter Networks," at the ACM Special Interest Group on Data Communication conference in Florianópolis, Brazil, in August.

The central processing unit in a computer generates a "clock signal" – a steady beat that tells the rest of the chip when to move forward a step in its program, like a drummer keeping a marching band together. Even if all the CPUs in a data center are the same model from the same manufacturer, differences in temperature, power supply or load can cause some of them to run at different rates. The goal is for each computer to recognize the "offset" between itself and another to which it is linked, and adjust the timing of its messages to the other accordingly.

DTP works behind the scenes at the "physical level" of a network. On Ethernet networks, data ordinarily travel in "packets" – strings of ones and zeros marked with a beginning and an end and containing a destination address and a payload of information. DTP sends computers information about their time difference by directly modifying the pulses of light that travel through , with no effect on the higher level packets.

Upgrading a data center to use the system would not be expensive, the researchers said, although the hardware that connects computers to the network would have to be modified to read and write the DTP signals. Weatherspoon is hoping for the addition of a DTP standard to the IEEE standards for Ethernet networks.

In tests at a Microsoft , DTP kept computers in sync to within 25.6 nanoseconds. "We scheduled every packet from every machine in a rack-scale system, resulting in reduced power, cost and size of the network fabric," said Weatherspoon. "They are very interested in this technology."

Explore further: Cornell collaboration with IBM to speed up 'the cloud'

Related Stories

Cornell collaboration with IBM to speed up 'the cloud'

March 16, 2010

( -- More and more of today's computing is happening in "the cloud" -- not just on the desktop or even on the big servers in the basement but all over the Net at once. Government agencies, banks and companies ...

Wireless data centers could be faster, cheaper, greener

September 27, 2012

(—Cornell computer scientists have proposed an innovative wireless design that could greatly reduce the cost and power consumption of massive cloud computing data centers, while improving performance.

Making a covert channel on the Internet

June 4, 2014

( —The best way to keep a message secret is not just to encrypt it, but to hide the fact that the message is even there. Computer scientists have created "covert channels" on the Internet, but they have been slow ...

Researchers work to take the errors out of the cloud

October 14, 2011

Cloud computing, which taps the resources of a network of remote computers, offers tremendous potential for storing and processing vast amounts of data quickly and cheaply. The catch: As cloud computing applications become ...

Are racks-on-chip the future of data centers?

November 5, 2013

( —Increasing the scale and decreasing the cost and power of data centers requires greatly boosting the density of computing, storage and networking within those centers. That is the hard truth spelled out in the ...

Data traffic system switches control to network administrators

November 3, 2016

Torrents of information flow through computer data centers, driving the operations of financial markets, communications systems, commerce and just about any complex web-based activity. Much of modern society is built on these ...

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...

Artificial enzymes convert solar energy into hydrogen gas

October 4, 2018

In a new scientific article, researchers at Uppsala University describe how, using a completely new method, they have synthesised an artificial enzyme that functions in the metabolism of living cells. These enzymes can utilize ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.