Jefferson Lab cluster tops 100 teraflops

Oct 15, 2010 By Kandice Carter

The fastest computer system in Hampton Roads has booted up with more than 100 Teraflops of processing power. Located at the Department of Energy's Thomas Jefferson National Accelerator Facility, the cluster computer system was recently upgraded with video game components to assist scientists in modeling the smallest bits of matter in the universe.

"Our resources crossed 100 Teraflops of sustained processing while running a science application. We finally hit the peak in late September," said Chip Watson, manager of Jefferson Lab's High-Performance Computing group in the Information Technology Division.

The supercomputer, called Hadron, was built with components that were purchased and cobbled together over the last year. It runs on both cards and ordinary computer processors. About 90 percent of its computing power comes from the video game graphics processing units, or GPUs.

The Hadron system contains 480 GPUs and 266 CPUs mounted inside computing chassis and screwed into racks side by side. Two parts run mainly on GPUs, dubbed 9g and 10g ('g' for GPU).

"We bought two different types of GPUs. We bought gaming cards, and we bought in the professional line for supercomputing. These cards are similar to the gaming cards, but they are configured somewhat differently and have error-correcting code built-in," Watson explained. "Some calculations we can do equally well on either card, and we do those calculations on the gaming cards. There are some calculations that involve much more, and those have to be on the professional-quality cards."

Hadron is being used to compute how the building blocks of matter, quarks, build the protons, neutrons and other particles that makeup everyday matter.

"GPUs are being used solely for propagator calculations - computing how a quark will move from one point in space to another point," said Robert Edwards, a senior staff scientist in Jefferson Lab's Theory group.

Once those calculations are done, the scientists then take the results and use them on a CPU-powered cluster computer. "We take the results from the GPUs and we tie this group of quarks together to make mesons or baryons. From this, we can compute the mass of these particles and their excited states," Edwards explained.

Watson used about $1 million of a nearly $5 million grant received as part of ARRA (American Recovery and Reinvestment Act) funding under the auspices of the Department of Energy's USQCD (US Quantum Chromodynamics) collaboration to purchase the 352 gaming cards and 128 professional graphics cards and associated hardware currently installed in the Hadron system. A chunk of the grant also went toward funding the effort to create computer code to adapt the GPUs for scientific computing.

Watson said that some of the GPUs and CPUs purchased for Hadron are still undergoing testing before being added to the system. "When we get all of the GPU systems running, the GPUs alone will exceed 100 Teraflops," he said.

In the meantime, Watson said he and his team continue to monitor the marketplace for the next big leap in technology.

"It looks like GPUs will be the hot topic for the next two or three years. We're keeping an eye on several technologies that could develop, and we're looking for something better that comes along," Watson said. "But it's been a fun year deploying this disruptive technology. Quite a fun year."

Explore further: Intel has end-to-end reference model for IoT

More information: An article about the first portion of the Hadron system (9g) to come online is available here: www.jlab.org/news/OnTarget/201… /2010-06/Story1.html

add to favorites email to friend print save as pdf

Related Stories

New computer cluster gets its grunt from games

Nov 25, 2009

Technology designed to blast aliens in computer games is part of a new GPU (Graphics Processing Units) computer cluster that will process CSIRO research data thousands of times faster and more efficiently ...

Software tool helps tap into the power of graphics processing

May 17, 2010

Today's computers rely on powerful graphics processing units (GPUs) to create the spectacular graphics in video games. In fact, these GPUs are now more powerful than the traditional central processing units (CPUs) - or brains ...

NVIDIA Announced New Geforce GTX 200 GPUs

Jun 16, 2008

Imagine instead of taking over five hours to convert a video for your iPod, it only takes 35 minutes. Imagine using your PC to simulate protein folding to help find a cure for debilitating diseases. Imagine ...

NVIDIA Ushers In the Era of Personal Supercomputing

Jun 21, 2007

High-performance computing in fields like the geosciences, molecular biology, and medical diagnostics enable discoveries that transform billions of lives every day. Universities, research institutions, and ...

Recommended for you

Sprint accused of billing for unwanted services

1 hour ago

(AP)—Federal regulators are accusing Sprint Corp. of illegally billing its wireless customers tens of millions of dollars in unwanted charges for text message alerts and other services.

BPG image format judged awesome versus JPEG

1 hour ago

If these three letters could talk, BPG, they would say something like "Farewell, JPEG." Better Portable Graphics (BPG) is a new image format based on HEVC and supported by browsers with a small Javascript ...

BlackBerry launches Classic in last-ditch effort

3 hours ago

(AP)—BlackBerry is returning to its roots with a new phone that features a traditional keyboard at a time when rival Apple and Android phones—and most smartphone customers—have embraced touch screens.

Cook farm waste into energy

4 hours ago

It takes some cooking, but turning farm waste into biofuels is now possible and makes economic sense, according to preliminary research from the University of Guelph.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.