From shared to distributed memory systems for applications

September 23, 2005

Shared-memory computing applications have never taken particularly well to operating on distributed-memory systems, at least until now. A possible solution has emerged, of interest to NASA and IBM, and is being tested on their distributed computing systems.

Funded under the European Commission’s IST programme, the POP project focused on generating an environment to allow applications designed using the OpenMP Application Program Interface (API) to operate on distributed-memory systems.

Developed by a consortium of computer vendors to enable the easy creation of portable, high-level shared-memory applications under the Fortran, C and C++ languages, OpenMP would be the perfect companion for distributed computing.

“However, it has not been a good companion to date,” says Jesús Labarta, the coordinator of the POP project at the Technical University of Catalonia.

The problem with OpenMP applications is that because they are designed for use in shared-memory systems, where memory is stored in a block and accessed by different processors, they do not function efficiently on distributed-memory machines where memory is accessed from different computers across a network. To make them run programmers have traditionally had to spend large amounts of time fiddling with code, often using a Message Passing Interface (MPI).

“What we have done is adapt OpenMP by extending and modifying protocols and runtime mechanisms to make it more flexible so programs can run on shared or distributed-memory systems without having to be retuned in each individual case,” Labarta explains. “The end goal is to allow OpenMP applications to run anywhere, reducing the time and costs of reprogramming.”

That is important for the future uses of OpenMP - principally for powerful numerical and simulation applications - given the increased use of distributed computing systems. Hence the interest of NASA and IBM.

In its cooperation with the project, NASA’s Ames research centre explored the possibility of employing POP’s OpenMP environment to overcome compatibility problems in parallelising their machines. The POP technique is also being tested on IBM’s MareNostrum supercomputer in Barcelona, the most powerful supercomputer in Europe to date, built entirely from commercially available components and using a Linux operating environment. On MareNostrum OpenMP applications are being run over various processor nodes in a distributed environment. “Without the work of POP, OpenMP wouldn’t run on MareNostrum,” the project coordinator notes.

Though the IST project ended in February this year, the researchers are continuing their work with a view to putting their OpenMP environment into widespread use. “The research is ongoing, although I think within three years our environment could be widely used and will have a substantial impact in the programming world,” Labarta says.

Source: IST Results

Explore further: Simulations lead to design of near-frictionless material

Related Stories

Simulations lead to design of near-frictionless material

July 22, 2015

Argonne scientists used Mira to identify and improve a new mechanism for eliminating friction, which fed into the development of a hybrid material that exhibited superlubricity at the macroscale for the first time. Argonne ...

Oak Ridge to acquire next generation supercomputer

November 14, 2014

The U.S. Department of Energy's Oak Ridge Leadership Computing Facility (OLCF) has signed a contract with IBM to bring a next-generation supercomputer to Oak Ridge National Laboratory (ORNL). The OLCF's new hybrid CPU/GPU ...

Intel Upgrades Software Tools to Support Mac OS X Leopard

November 28, 2007

Intel Corporation today announced an upgrade of its popular software tools suite for Mac OS X Leopard, the sixth major version of Apple's advanced operating system. The latest 10.1 version of the Intel C++ Compiler and Intel ...

Recommended for you

New Horizons team selects potential Kuiper Belt flyby target

August 29, 2015

NASA has selected the potential next destination for the New Horizons mission to visit after its historic July 14 flyby of the Pluto system. The destination is a small Kuiper Belt object (KBO) known as 2014 MU69 that orbits ...

Seeing quantum motion

August 28, 2015

Consider the pendulum of a grandfather clock. If you forget to wind it, you will eventually find the pendulum at rest, unmoving. However, this simple observation is only valid at the level of classical physics—the laws ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.