20 petaflops: New supercomputer for Oak Ridge facility to regain speed lead over the Chinese

Mar 23, 2011 by Bob Yirka report
Image credit: ORNL presentation (see link below)

(PhysOrg.com) -- The Oak Ridge National Laboratory (ORNL) campus in Oak Ridge Tennessee will soon play host once again to the fastest computer in the world (barring any new sudden announcements by the Chinese). The computer, dubbed "Titan" has been commissioned by the U.S. Department of Energy, and is expected to achieve 20,000 trillion calculations (20 petaflops) per second.

It was only last October that ’s National University of Defense team unveiled the Tianhe-1A, a machine capable of computing at 2.5 .

The Titan, built by Cray Computer, will become part of a collection of some of the fastest computers in the world at the ORNL facility, joining NOAA’s Gaea, the NSF’s Kraken and the DOE’s current workhorse, the Jaguar, though new space will have to be found, as the current structure has no room. Plans are in the works for an entirely new facility to be built over the next year, which should fit in well with the delivery date for the first stage of the Titan expected to be by the end of this year, with the second stage slated for sometime next year.

The Titan architecture will rely on use of XT3, 4 and 5 processor boxes, but will use a "Gemini" XE interconnect, and it will be configured in a 3D torus topology, rather than as an array.

Supercomputers achieve their ability to process enormous amounts of data in very short amounts of time by in essence, hooking together a lot of processing boxes and then using a device to connect them all together, this is why the Gemini XE interconnect is so important; it’s actually one of only two new pieces of proprietary hardware that will be added to create the new machine; the other is the Graphics Display Unit (GDU) co-processor (likely provided by Nvidia) that will help to perform calculations more quickly. This is also why computer scientists are so easily able to choose ahead of time just how fast a new computer will be; the more processor boxes you add, the faster the end result, so long as you have an interconnect that can handle them. The Titan will also use what is being described as “globally addressable memory,” which means data won’t have to slow down as it passes through I/O channels.

The Titan is expected to be used by the DOE to calculate complex energy systems and will cost the government somewhere in the neighborhood of $100 million dollars.

Explore further: Toshiba to launch world's fastest microSD memory cards

More information: computing.ornl.gov/SC10/documents/SC10_Booth_Talk_Bland.pdf

Related Stories

NVIDIA GPUs power world's fastest supercomputer

Oct 29, 2010

(PhysOrg.com) -- NVIDIA has built the worldэs fastest supercomputer using 7,000 of its graphics processor chips. With a horsepower equivalent to 175,000 laptop computers, its sustained performance is ...

ORNL Jaguar supercomputer surpasses 50 teraflops

Aug 25, 2006

An upgrade to the Cray XT3 supercomputer at Oak Ridge National Laboratory, the most powerful supercomputer available for general scientific research in the United States, has increased the system's computing ...

China boasts world's fastest supercomputer

Oct 28, 2010

China is set to trump the US to take the number one spot for the fastest supercomputer ever made in a survey of the world's zippiest machines, it was reported Thursday.

Rings on the horizon

Jan 26, 2011

The Cassini spacecraft has taken a some recent images of two of Saturn’s most notorious moons, where in both images the planet’s rings serve as a backdrop. Above, Enceladus stands out with its cratered ...

Twenty-two Projects Keep Supercomputer Super Busy

Oct 25, 2006

With 54 teraflops of computing power, Oak Ridge National Laboratory’s Cray XT3 is helping solve scientific grand challenges, but scheduling the many research projects and keeping the massive machine operating at peak capacity ...

Recommended for you

Ex-Apple chief plans mobile phone for India

8 hours ago

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Health care site flagged in Heartbleed review

21 hours ago

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

Airbnb rental site raises $450 mn

21 hours ago

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Four questions about missing Malaysian plane answered

21 hours ago

Travelers at Asian airports have asked questions about the March 8 disappearance of Malaysia Airlines Flight 370 while en route from Kuala Lumpur to Beijing. Here are some of them, followed by answers.

Android gains in US, basic phones almost extinct

Apr 18, 2014

The Google Android platform grabbed the majority of mobile phones in the US market in early 2014, as consumers all but abandoned non-smartphone handsets, a survey showed Friday.

User comments : 18

Adjust slider to filter visible comments by rank

Display comments: newest first

Resonance
5 / 5 (3) Mar 23, 2011
Can it play Starcraft 2 on full settings?
apex01
2.3 / 5 (3) Mar 23, 2011
Wow, this beats the Chinese supercomputer by 17.5 petaflops. Thats like 7 fold increase in power!
SteveL
3 / 5 (1) Mar 23, 2011
Can it play Starcraft 2 on full settings?


And I was just wondering how many government employees could play World of Warcraft on that system.

But in all seriousness.. While I tend to wonder what all this computing power is good for, I still appreciate the advancement of technology.
kaasinees
5 / 5 (1) Mar 23, 2011
flops per watt?

just raw flops dont mean anything. There is no comparitable unit (flops/watt)
StarDust21
5 / 5 (1) Mar 23, 2011
Can it play Starcraft 2 on full settings?

Studies suggest it will still lag a bit a extreme graphic settings
jselin
5 / 5 (3) Mar 23, 2011
But in all seriousness.. While I tend to wonder what all this computing power is good for, I still appreciate the advancement of technology.

Running simulations are resource intensive... ideally you'd like to consider a system with as few simplifications as possible, at reasonably high resolution, and with fine time steps. Degrees of freedom goes through the roof and so does the solve time. If every engineer/scientist/researcher had this sort of power at their fingertips we'd really be cooking with gas. Even top of the line desktops are still pretty useless in this arena so theres a long way to go in the consumer market as well.
El_Nose
5 / 5 (2) Mar 23, 2011
what can it do --- i don;t know -- but consider this

when scientists model the sun using real physics they take a 2d slice of the sun to run simulations on -- basically they pretend that a slice with NO WIDTH gives pretty good insight into stellar habits

why would they do this -- well a 3d slice as a model is too computational expensive -- the simulation would not end in our lifetime because it would be TOO complex.

These machines can simulate the inside of a nuclear reaction, star formation, folding of protiens, simulating drugs, or hold all known star corrdinates and known motion and tell us where galaxies likely ACTUALLY are instead of our view point looking millions of years into the past... if we wanted to travel to a galaxy we would need to go to where it actually is not where we see it based on the speed of light. These things are computational expensive and super computers can do them.
fuviss_co_uk
5 / 5 (3) Mar 23, 2011
i am waiting for exaflop supercomputer, I will create simulation of my life on it
Parsec
4.5 / 5 (4) Mar 23, 2011
i am waiting for exaflop supercomputer, I will create simulation of my life on it

I was one of those who build an 8080 IMSI computer when the original article describing it was published in March 1975 in Popular Science (Pop Electronics was several years away then). At that time, processor speeds were in the few hundred thousand instructions per second. To do floating point math took about a hundred instructions, so while the kiloflops wasn't exactly coined yet, that computer would have been in the low dozens of kiloflops. I have seen the increases goto to megaflops, gigaflops, etc.
I have no doubt that when chips with thousands of processors on a single chip are released (currently in the works by Intel among others), we will be seeing pentaflops give way to the next higher unit (I am too lazy to look it up), etc.
yyz
5 / 5 (1) Mar 23, 2011
"i am waiting for exaflop supercomputer, I will create simulation of my life on it"

I have an interest in exaflop computing myself (exaflop=10^18 flops per second).

Currently, researchers designing the Square Kilometer Array (SKA) radio telescope are collaborating with IBM to build an exaflop-capable machine to handle the flood of data SKA will generate (due date ~2020): http://www.comput...pdated_/

Cray and several European partners are pursuing exaflop machines for other purposes (again with a due date ~2020): http://www.eetime...n-Europe

To be sure, Intel predicts zettaflop performance (10^21 flops per second) in supercomputers sometime around 2030: http://www.h-onli...779.html

nada
not rated yet Mar 23, 2011
Article doesn't say it but

FYI its running Cray's Linux operating system.

SteveL
5 / 5 (3) Mar 23, 2011
folding of protiens,


My PS3 is among about 1 million others around the world doing protien folding (folding@home - with 2770 work units completed by my system so far). Not to mention hundreds of thousands of PCs. Per thier estimate they do about 1 petaflop per 50,000 PS3's. So, with about 1 million PS3's running folding@home, we functionally already have a 20 petaflop distributed computer system. With classified research I can see the use for discrete systems, but there are literally millions of us computer enthusiasts who are more than willing to contribute our computer down time for viable distributed computing projects.

From: h_t_t_p://boinc.berkeley.edu/

"Active: 320,153 volunteers, 514,614 computers.
24-hour average: 5,620.64 TeraFLOPS."

If anyone is interested there are well over 100 distributed (Boinc and non-Boinc) computing projects to participate in. All 4 cores of my home system stay busy with einstein@home.
PinkElephant
5 / 5 (5) Mar 23, 2011
Here's a fun calculation: rough estimate of performance required to accurately simulate Earth's atmospheric circulation.

Surface of Earth: 5.1x10^15 m^2.
Height of atmosphere (incl. stratosphere): 5x10^4 m

Start with weather:
cell dimensions: 10x10x10 m
Total number of cells in grid: 2.55x10^17
time step: 10 seconds.
complexity: ~10^4 flop/cell/iteration.

To simulate 1 week worth of global weather: 1.5x10^27 flop. A zetaflop computer (50,000 times faster than the 20 petaflop one proposed above, which Intel expects by 2030) would take 7.7 days to complete such a simulation run -- assuming it operates at 100% load.

What about climate?
cell dimensions: 100x100x50 m
Total number of cells in grid: 5.1x10^14
time step: 1 minute
complexity: ~10^6 flop/cell/iteration

To simulate 100 years worth of global climate: 2.7x10^28 flop -- roughly 43 days on a zetaflop machine at 100% utilization.

One can never have too much computing power...
PinkElephant
5 / 5 (1) Mar 23, 2011
Here's another one: simulating a human brain in real time. What would be the required performance of a general-purpose computer?

10^11 neurons (on the order of)
10^4 synapses per neuron (average)
10^3 spikes per synapse, per second (maximum rate) -- so let's use timestep of 0.1 millisecond: 10^4 timesteps/second
10^2 flop/synapse/time step (to include simulation of conduction, integration, potentiation/depression of synapses, and growth/modification of axon/dendrite trees.)

Comes out to 10^21 flops. That's 1 zetaflop/sec, folks.

And let's note that this ignores (for simplicity) the roughly 100x greater quantity of glial cells than neurons in the brain, all of which may actually participate in neural computation to some extent (according to some recent studies...)
fuviss_co_uk
not rated yet Mar 24, 2011
thanks to cloud computing, we may achieve zetaflop supercomputer platform in 2020, even if we will connect only our future smartphones, tablets and some other gadgets of the future
Aliensarethere
1 / 5 (1) Mar 24, 2011
thanks to cloud computing, we may achieve zetaflop supercomputer platform in 2020, even if we will connect only our future smartphones, tablets and some other gadgets of the future


Don't underestimate smartphones. Nvidia has an aggressive roadmap for CPU's:
http://www.tomsha...-roadmap
Noumenon
5 / 5 (44) Mar 24, 2011
Maybe we'll live to see Hal's ancestor yet.
lexington
1 / 5 (2) Mar 24, 2011
thanks to cloud computing, we may achieve zetaflop supercomputer platform in 2020, even if we will connect only our future smartphones, tablets and some other gadgets of the future

Idiot we'll all be dead from the 2012 doomsday when Nibiru makes the galaxy explode.

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...