From shared to distributed memory systems for applications

Sep 23, 2005

Shared-memory computing applications have never taken particularly well to operating on distributed-memory systems, at least until now. A possible solution has emerged, of interest to NASA and IBM, and is being tested on their distributed computing systems.

Funded under the European Commission’s IST programme, the POP project focused on generating an environment to allow applications designed using the OpenMP Application Program Interface (API) to operate on distributed-memory systems.

Developed by a consortium of computer vendors to enable the easy creation of portable, high-level shared-memory applications under the Fortran, C and C++ languages, OpenMP would be the perfect companion for distributed computing.

“However, it has not been a good companion to date,” says Jesús Labarta, the coordinator of the POP project at the Technical University of Catalonia.

The problem with OpenMP applications is that because they are designed for use in shared-memory systems, where memory is stored in a block and accessed by different processors, they do not function efficiently on distributed-memory machines where memory is accessed from different computers across a network. To make them run programmers have traditionally had to spend large amounts of time fiddling with code, often using a Message Passing Interface (MPI).

“What we have done is adapt OpenMP by extending and modifying protocols and runtime mechanisms to make it more flexible so programs can run on shared or distributed-memory systems without having to be retuned in each individual case,” Labarta explains. “The end goal is to allow OpenMP applications to run anywhere, reducing the time and costs of reprogramming.”

That is important for the future uses of OpenMP - principally for powerful numerical and simulation applications - given the increased use of distributed computing systems. Hence the interest of NASA and IBM.

In its cooperation with the project, NASA’s Ames research centre explored the possibility of employing POP’s OpenMP environment to overcome compatibility problems in parallelising their machines. The POP technique is also being tested on IBM’s MareNostrum supercomputer in Barcelona, the most powerful supercomputer in Europe to date, built entirely from commercially available components and using a Linux operating environment. On MareNostrum OpenMP applications are being run over various processor nodes in a distributed environment. “Without the work of POP, OpenMP wouldn’t run on MareNostrum,” the project coordinator notes.

Though the IST project ended in February this year, the researchers are continuing their work with a view to putting their OpenMP environment into widespread use. “The research is ongoing, although I think within three years our environment could be widely used and will have a substantial impact in the programming world,” Labarta says.

Source: IST Results

Explore further: Why the Sony hack isn't big news in Japan

add to favorites email to friend print save as pdf

Related Stories

Oak Ridge to acquire next generation supercomputer

Nov 14, 2014

The U.S. Department of Energy's Oak Ridge Leadership Computing Facility (OLCF) has signed a contract with IBM to bring a next-generation supercomputer to Oak Ridge National Laboratory (ORNL). The OLCF's new ...

Intel Upgrades Software Tools to Support Mac OS X Leopard

Nov 28, 2007

Intel Corporation today announced an upgrade of its popular software tools suite for Mac OS X Leopard, the sixth major version of Apple's advanced operating system. The latest 10.1 version of the Intel C++ Compiler and Intel ...

Recommended for you

Why the Sony hack isn't big news in Japan

15 hours ago

Japan's biggest newspaper, Yomiuri Shimbun, featured a story about Sony Corp. on its website Friday. It wasn't about hacking. It was about the company's struggling tablet business.

Off-world manufacturing is a go with space printer

19 hours ago

On Friday, the BBC reported on a NASA email exchange with a space station which involved astronauts on the International Space Station using their 3-D printer to make a wrench from instructions sent up in ...

Cadillac CT6 will get streaming video mirror

20 hours ago

Cadillac said Thursday it will add high resolution streaming video to the function of a rearview mirror, so that the driver's vision and safety can be enhanced. The technology will debut on the 2016 Cadillac ...

Sony faces 4th ex-employee lawsuit over hack

20 hours ago

A former director of technology for Sony Pictures Entertainment has sued the company over the data breach that resulted in the online posting of his private financial and personal information.

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.