Blue Gene active storage boosts I/O performance at JSC

November 18, 2013
The BGAS system is attached to the supercomputer JUQUEEN installed at Jülich Supercomputing Centre (JSC). This Blue Gene/Q system is currently the most powerful system in Europe. Credit: Forschungszentrum Jülich

The ever growing complexity of various simulation tasks not only require a continuous increase of computing power but also the capability of managing large amounts of data. Realisation of an active storage architecture and integration of non-volatile memory into Blue Gene/Q enables data intensive applications to exploit the performance of this highly scalable high-performance computing system by IBM. The BGAS system is the result of a close collaboration between Forschungszentrum Jülich and IBM in the framework of the Exascale Innovation Centre. It is attached to the supercomputer JUQUEEN installed at Jülich Supercomputing Centre (JSC). This Blue Gene/Q system is currently the most powerful system in Europe.

Active is an architectural concept that addresses the increasing costs of data transport between compute and storage systems. Therefore, computing power and storage are much more tightly integrated. In addition, in BGAS this is combined with the power of technologies which feature not only high bandwidth but in particular very high access rates. The BGAS system at JSC consists of 32 nodes each connected to a newly designed PCIe card comprising 2 TBytes of SLC NAND flash memory. The BGAS nodes are interconnected within a 3-dimensional torus network. Furthermore, each node is connected to a Blue Gene/Q compute system and to an external storage facility. This architecture is particularly suitable for data intensive tasks and thus enables new research.

"Highly complex simulations such as in brain research generate large volumes of data that can no longer be processed by conventional methods. New I/O concepts are therefore one of the most important steps to achieve new research results using high-performance computers in these areas," says the director of JSC, Prof. Thomas Lippert.

New opportunities for neuroscience simulations

The opportunities of the newly installed BGAS had been immediately recognised by the computational neuroscientists at Forschungszentrum Jülich. "During extensive simulations of neuronal networks large amounts of data must be stored externally in order to be analyzed later," says Prof. Markus Diesmann. The director at the Institute of Neuroscience and Medicine is one of the developers of the freely available software NEST, which is used by neuroscientists worldwide. However, no typical HPC system does provide sufficient I/O capabilities to cope with the generated data that researchers would like to analyse. "BGAS can sustain the required data rates and provides the compute power to analyse this data," says Markus Diesmann. The new storage system additionally facilitates interactive access to the data.

Drawer of the Blue Gene Active Storage system containing eight HS4 Cards (at the back right). In total, four of these units are incorporated into the system.

A team led by the Jülich neuroscientist recently succeeded in simulating the largest neuronal network to date consisting of 1.73 billion nerve cells on the Japanese K computer. The result demonstrates that the neuroscientists can make full use of existing petascale supercomputers.

Explore further: Data storage and next-generation non-volatile memory technology

Related Stories

UCSC acquires powerful new astrophysics supercomputer system

July 31, 2013

State-of-the-art computer systems have been instrumental in making UC Santa Cruz one of the world's leading centers for computational astrophysics and planetary science. A new supercomputer recently installed on campus provides ...

Supercomputer boosted with graphic processors

September 11, 2013

With "Piz Daint" the Swiss National Supercomputing Centre (CSCS) is putting a new supercomputer system in operation that will provide the necessary compute performance and consume less power. This is made possible by a novel ...

LLNL, Intel, Cray produce big data machine

November 5, 2013

(Phys.org) —Lawrence Livermore National Laboratory in partnership with Intel and Cray, today announced a unique high-performance computing (HPC) cluster that will serve research scientists at all three institutions and ...

Recommended for you

Power grid forecasting tool reduces costly errors

July 30, 2015

Accurately forecasting future electricity needs is tricky, with sudden weather changes and other variables impacting projections minute by minute. Errors can have grave repercussions, from blackouts to high market costs. ...

Netherlands bank customers can get vocal on payments

August 1, 2015

Are some people fed up with remembering and using passwords and PINs to make it though the day? Those who have had enough would prefer to do without them. For mobile tasks that involve banking, though, it is obvious that ...

Microsoft describes hard-to-mimic authentication gesture

August 1, 2015

Photos. Messages. Bank account codes. And so much more—sit on a person's mobile device, and the question is, how to secure them without having to depend on lengthy password codes of letters and numbers. Vendors promoting ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.