ORNL completes first phase of Titan supercomputer transition

Feb 29, 2012

Oak Ridge National Laboratory's Jaguar supercomputer has completed the first phase of an upgrade that will keep it among the most powerful scientific computing systems in the world.

Acceptance testing for the upgrade was completed earlier this month. The testing suite included leading scientific applications focused on , high-temperature superconductivity, , and combustion.

Jaguar, manufactured by ., is operated by the Oak Ridge Leadership (OLCF). Even before this month's upgrade to 3.3 petaflops it was the United States' most powerful supercomputer, capable of 2,300 trillion calculations each second, or 2.3 petaflops. The same number of calculations would take an individual working at a rate of one per second more than 70 million years.

When the upgrade process is completed this autumn, the system will be renamed Titan and will be capable of 10 to 20 petaflops. Users have had access to Jaguar throughout the upgrade process.

"During our upgrade, we have kept our users on Jaguar every chance we get," said Jack Wells, director of science at the OLCF, "We have already seen the positive impact on applications, for example in , from the doubled memory."

The DOE Office of Science-funded project, which was concluded ahead of schedule, upgraded Jaguar's AMD Opteron cores to the newest 6200 series and increased their number by a third, from 224,256 to 299,008. Two six-core Opteron processors were removed from each of Jaguar's 18,688 nodes and replaced with a single 16-core processor. At the same time, the system's interconnect was updated and its memory was doubled to 600 terabytes.

In addition, 960 of Jaguar's 18,688 compute nodes now contain an NVIDIA graphical processing unit (GPU). The GPUs were added to the system in anticipation of a much larger GPU installation later in the year. The GPUs act as accelerators, giving researchers a serious boost in in a far more energy-efficient system.

"Applications that were squeezing onto our Cray XT5 nodes can now make full use of the 16-core processor. Doubling the memory can have a dramatic impact on application workflow," Wells said.

"The new Gemini interconnect is much more scalable," Wells added, "helping applications like molecular dynamics that have demanding network communication requirements."

GPUs will add a level of parallelism to the system and allow Titan to reach 10 to 20 petaflops within the same space as Jaguar and with essentially the same power requirements. While the Opteron processors have 16 cores and are therefore able to carry out 16 computing tasks simultaneously, the GPUs will be able to tackle hundreds of computing tasks at the same time.

With nearly 1,000 GPUs now available, researchers will have an opportunity to optimize their applications for the accelerated Titan system.

"This is going to be an exciting year in Oak Ridge as our users take advantage of our new XK6 architecture and get ready for the new NVIDIA Kepler GPUs in the fall," Wells said. "A lot of work by many people is beginning to pay off."

Explore further: World's largest 4K video board

add to favorites email to friend print save as pdf

Related Stories

'Jaguar' supercomputer gaining speed

Oct 12, 2011

Cray Inc. said it has sealed a deal to overhaul the US Department of Energy's "Jaguar" supercomputer, making it faster than any other machine on the planet.

ORNL Jaguar supercomputer surpasses 50 teraflops

Aug 25, 2006

An upgrade to the Cray XT3 supercomputer at Oak Ridge National Laboratory, the most powerful supercomputer available for general scientific research in the United States, has increased the system's computing ...

Jaguar upgrade brings ORNL closer to petascale computing

May 15, 2008

Upgrades to Oak Ridge National Laboratory’s Jaguar supercomputer have more than doubled its performance, increasing the system’s ability to deliver far-reaching advances in climate studies, energy research, and a wide ...

Recommended for you

Facebook buys fitness app Moves

3 hours ago

Facebook has bought the fitness app Moves, which helps users monitor daily physical activity and their calorie counts on a smartphone.

User comments : 0

More news stories

Facebook buys fitness app Moves

Facebook has bought the fitness app Moves, which helps users monitor daily physical activity and their calorie counts on a smartphone.

Autism Genome Project delivers genetic discovery

A new study from investigators with the Autism Genome Project, the world's largest research project on identifying genes associated with risk for autism, has found that the comprehensive use of copy number variant (CNV) genetic ...

Study links California drought to global warming

While researchers have sometimes connected weather extremes to man-made global warming, usually it is not done in real time. Now a study is asserting a link between climate change and both the intensifying California drought ...