Scalable clusters make HPC R&D easy as Raspberry Pi

November 13, 2017
The BitScope Pi Cluster Modules system creates an affordable, scalable, highly parallel testbed for high-performance-computing system-software developers. The system comprises five rack-mounted BitScope Pi Cluster Modules consisting of 3,000 cores using Raspberry Pi ARM processor boards, fully integrated with network switching infrastructure. Credit: Bitscope

A quest to help the systems software community work on very large supercomputers without having to actually test on them has spawned an affordable, scalable system using thousands of inexpensive Raspberry Pi nodes. It brings a powerful high-performance-computing testbed to system-software developers, researchers, and others who lack machine time on the world's fastest supercomputers.

"It's not like you can keep a petascale machine around for R&D work in scalable systems software," said Gary Grider, leader of the High Performance Computing Division at Los Alamos National Laboratory, home of the Trinity supercomputer. "The Raspberry Pi modules let developers figure out how to write this software and get it to work reliably without having a dedicated testbed of the same size, which would cost a quarter billion dollars and use 25 megawatts of electricity."

Grider conceived the new solution to provide the systems software community with an inexpensive testbed of similar scale to the largest supercomputers being deployed. Designed and built by BitScope and distributed by SICORP, the Pi Cluster Modules enable developers to build, scale and test software before launching it on Trinity, Crossroads, and other large systems. The modules have other potential applications from education to the internet of things.

The BitScope system consists of five rack-mounted Pi Cluster Modules, each with 150 four-core nodes of Raspberry Pi ARM processor boards. They are fully integrated with network switching infrastructure. With a total of 750 CPUs or 3,000 cores working together, the system gives developers exclusive time on an inexpensive but highly parallelized platform for test and validation of scalable systems software technologies.

"Having worked with Raspberry Pi for quite some time, I've long thought it the ideal candidate to build low-cost cloud and cluster computing solutions for research and education," said Bruce Tulloch, CEO of BitScope. "When SICORP approached us with Gary's plans, we jumped at the opportunity to prove the concept."

The Raspberry Pi is an inexpensive, credit-card sized computer that can be connected to a keyboard and TV to do just about anything a typical desktop computer can do. It was developed by the Raspberry Pi Foundation in the United Kingdom to help spread computing in education and in developing countries. The price for a basic model starts at about $25 and consumes only a handful of watts of power.

Beyond HPC system-software development, additional applications for the Pi Cluster Modules include better simulation of large-scale sensor networks, with flexible I/O to connect the actual sensor devices; HPC network topology research, to improve production performance; and the internet of things.

Looking around for a solution to the challenges facing HPC systems developers, Grider said, he "suddenly realized the Raspberry Pi was an inexpensive computer using 2 to 3 watts that you could use to build a several-thousand-node system large enough to provide a low-cost, low-power testbed to enable this R&D." Yet he could not find a suitable densely packaged Raspberry Pi system on the market.

"It was just people building clusters with Tinker Toys and Legos," said Grider, a widely respected innovator in the HPC world. So he turned to SICORP of Albuquerque, N.M., to collaborate on a solution. Then they jointly worked with BitScope of Australia to develop easily scaled rack-mounted units.

Explore further: Engineers build Raspberry Pi supercomputer

Related Stories

New Raspberry Pi 2 carries more power at same price

February 3, 2015

Wait a minute, what's with all the headlines this week on Raspberry Pi? We already know there is a Foundation behind it which pioneered this cheaply priced computing item to foster education and support builders, that it ...

Raspberry Pi posts news about camera board and prize winner

November 26, 2012

(Phys.org)—Recent announcements on the Raspberry Pi site had two items on the topic of cameras, with the November 23 announcement of a camera board demo of the upcoming Raspberry Pi camera module and on November 22 with ...

Recommended for you

A not-quite-random walk demystifies the algorithm

December 15, 2017

The algorithm is having a cultural moment. Originally a math and computer science term, algorithms are now used to account for everything from military drone strikes and financial market forecasts to Google search results.

US faces moment of truth on 'net neutrality'

December 14, 2017

The acrimonious battle over "net neutrality" in America comes to a head Thursday with a US agency set to vote to roll back rules enacted two years earlier aimed at preventing a "two-speed" internet.

FCC votes along party lines to end 'net neutrality' (Update)

December 14, 2017

The Federal Communications Commission repealed the Obama-era "net neutrality" rules Thursday, giving internet service providers like Verizon, Comcast and AT&T a free hand to slow or block websites and apps as they see fit ...

The wet road to fast and stable batteries

December 14, 2017

An international team of scientists—including several researchers from the U.S. Department of Energy's (DOE) Argonne National Laboratory—has discovered an anode battery material with superfast charging and stable operation ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.