US National Laboratory’s High Performance Computing Division has 750-node Raspberry Pi clusters

The National Laboratory’s High Performance Computing Division Los Alamos has access to 750-node Raspberry Pi clusters which it is using in development work.

SuperComputing 17, an annual conference on high-performance computing, was told that the Raspberry Pi-based clusters were part of the first step towards a development program to assist in programming much larger machines.

The platform at LANL uses a modular cluster design from BitScope Designs, with five rack-mount Bitscope Cluster Modules, each with 150 Raspberry Pi boards with integrated network switches.

With each of the 750 chips having four cores, it offers a 3000-core highly parallelisable platform that emulates an ARM-based supercomputer, allowing researchers to test development code without requiring a power-hungry machine at significant cost to the taxpayer.

The full 750-node cluster, running 2-3 W per processor, runs at 1000W idle, 3000W at typical and 4000W at peak - with the switches - and is substantially cheaper, if also computationally a lot slower.

After development using the Pi clusters, frameworks can then be ported to the larger scale supercomputers available at LANL, such as Trinity and Crossroads.leader of the High Performance Computing Division at Los Alamos National Laboratory, Gary Grider, told the conference: “It’s not like you can keep a petascale machine around for R&D work in scalable systems software. The Raspberry Pi modules let developers figure out how to write this software and get it to work reliably without having a dedicated testbed of the same size, which would cost a quarter billion dollars and use 25 megawatts of electricity.”

The collaboration between LANL and BitScope was formed after the inability to find a suitable dense server that offered a platform for several-thousand-node networking and optimisation – most solutions on the market were too expensive, and anyone offering something like the Pi in a dense form factor was ‘just people building clusters with Tinker Toys and Lego’.

BitScope says that each node will be about $120 fully provisioned using the element14 version of the latest Raspberry Pi (normally $35 at retail). That means that a 150-node Cluster Module will fall in around $18k-$20k each.