Not the largest supercomputer, but maybe the most interesting

Sandia Labs, NextSilicon abandon design norms to pursue technological frontier

Publication Date:

Sandia news media contact

Troy Rummler
trummle@sandia.gov
505-249-3632

Media Downloads

Caption

Spectra is Sandia National Laboratories' newest supercomputer and the second in the Vanguard program, which explores advanced computer architectures for national security applications.

Credits

Photo by Craig Fritz

Caption

Sandia National Laboratories' Spectra features 64 compute nodes, each equipped with two second-generation Maverick Open Accelerator Module devices like the one pictured here. Each device hosts two Maverick-2 accelerators in a dual-die configuration.

Credits

Photo courtesy of NextSilicon

Caption

Penguin Solutions integrated the thermal management and power distribution systems for Spectra, and led the installation at Sandia National Laboratories.

Credits

Photo by Craig Fritz

Spectra supercomputer exterior
Spectra is Sandia National Laboratories’ newest supercomputer and the second in the Vanguard program, which explores advanced computer architectures for national security applications. (Photo by Craig Fritz) Click on the thumbnail for a high-resolution image.

ALBUQUERQUE, N.M. — A new kind of supercomputer has arrived at Sandia National Laboratories, and while it’s not the largest in the world, it may be one of the most unconventional.

Designed through a collaboration between Sandia and tech company NextSilicon, the new prototype system called Spectra is designed to process data in a fundamentally different way than most computers. If successful, Spectra could reshape how the nation performs high-stakes simulations critical to its nuclear deterrence mission.

Spectra features 128 of NextSilicon’s Maverick-2 dual-die accelerators, specialized chips that analyze code to prioritize tasks in real time. This is a major design departure from CPUs or GPUs, which typically treat all data equally. The potential payoff is increased performance and reduced power consumption. It is the first supercomputer to incorporate this new chip architecture.

“We have deployed a first-of-its-kind computing capability,” said Sandia senior scientist and project lead James Laros. “And it’s the result of this tremendous partnership between the national labs and industry.”

Sandia researchers will now push the limits of this new advanced architecture prototype. They’re leading a consortium with Lawrence Livermore and Los Alamos national laboratories under the National Nuclear Security Administration’s Advanced Simulation and Computing program. Ultimately, the team wants to know how the system handles national security-related tasks such as advanced fluid dynamics simulations, which help assess the safety and reliability of the nation’s nuclear deterrent without underground testing.

If successful, the research could mark a path forward for more sophisticated simulations.

Vanguard program pushes frontiers of computing technology

Spectra is the second platform deployed as part of Sandia’s Vanguard program, which explores the viability of emerging technologies for ASC mission applications.

Sandia National Laboratories' Spectra features 64 compute nodes, each equipped with two second-generation Maverick Open Accelerator Module devices like the one pictured here. Each device hosts two Maverick-2 accelerators in a dual-die configuration. (Photo courtesy of NextSilicon) Click on the thumbnail for a high-resolution image.
Sandia National Laboratories’ Spectra features 64 compute nodes, each equipped with two second-generation Maverick Open Accelerator Module devices like the one pictured here. Each device hosts two Maverick-2 accelerators in a dual-die configuration. (Photo courtesy of NextSilicon) Click on the thumbnail for a high-resolution image.

“By deploying prototype systems, we investigate whether new technologies can be integrated into our large production platforms in the coming years,” said Simon Hammond, director of the Office of Advanced Simulation and Computing and Institutional Research and Development Programs at the National Nuclear Security Administration.

The first Vanguard system, Astra, was the world’s fastest Arm-based supercomputer in 2018. It was a pivotal experiment showing that Arm processors, traditionally used in embedded applications like cellphones and car electronics, could be successfully adapted for heavyweight jobs such as modeling and simulation.

“While it seems obvious today that Arm-based processors can handle demanding workloads, at the time of Astra’s deployment the software stacks, compilers and libraries were untested and lacked necessary optimizations for production environments,” Hammond said.

Astra’s success paved the way for other labs to follow. Los Alamos National Laboratory deployed Venado, a full-size, partially Arm-based supercomputer, in 2024. Now Sandia and NextSilicon aim to achieve a new technology milestone with Spectra, focusing on efficiency and adaptive computing.

Enhancing efficiency and performance

“Breakthrough scientific discoveries require breakthrough computing architectures,” said NextSilicon CEO Elad Raz. “We built Maverick-2 because when researchers wait hours for simulations that could unlock major breakthroughs, the bottleneck isn’t human imagination — it’s computing efficiency.”

An advantage of the Maverick-2’s experimental design is that it simplifies porting applications to the new system. Raz said, “We deliver up to 10x performance improvements at half the power without requiring users to rewrite their applications.”

This could save months to years of work researchers normally spend optimizing their software to the latest hardware, making NNSA programs more agile and saving taxpayer dollars.

While Sandia will evaluate the extent of this backward compatibility, Laros confirmed that on day one the system could support the supercomputing benchmark test HPCG, the molecular dynamics simulation LAMMPS and the Monte Carlo code SPARTA, which Sandia researchers regularly use to simulate low-density gases.

Plenty of room to grow

Spectra supercomputer interior
Penguin Solutions integrated the thermal management and power distribution systems for Spectra, and led the installation at Sandia National Laboratories. (Photo by Craig Fritz) Click on the thumbnail for a high-resolution image.

Spectra was integrated and installed by Penguin Solutions with scalability in mind. The company designed an innovative server that can support up to four high-performance NextSilicon Open Accelerator Modules running at full power, although the current setup uses two.

“We engineered a system with aggressive capabilities so that Sandia could fully explore the entire envelope of power and performance of the chips over time,” said Phil Pokorny, chief technology officer at Penguin Solutions. “Sandia will have plenty of room to grow this cluster to higher levels of performance.”

An advanced Chilldyne negative pressure liquid cooling system and Penguin’s Tundra infrastructure, which optimizes thermal management, power distribution and scaling, enable the flexibility. Penguin successfully adapted these solutions to the power infrastructure of Sandia’s data center.

“Revolutionary new designs are among the most fascinating to learn about and work on,” Pokorny said. “Being part of delivering such a new design is a rare opportunity. It’s very exciting!”

For Sandia and NNSA, Spectra represents more than another supercomputer. It’s a testbed for a future where computing breakthroughs come not from bigger machines, but from smarter, more adaptive designs.

 

Sandia National Laboratories is a multimission laboratory operated by National Technology and Engineering Solutions of Sandia LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration. Sandia Labs has major research and development responsibilities in nuclear deterrence, global security, defense, energy technologies and economic competitiveness, with main facilities in Albuquerque, New Mexico, and Livermore, California.

Sandia news media contact

Troy Rummler
trummle@sandia.gov
505-249-3632