Supercomputer benchmark gains adherents

Publication Date:

Sandia news media contact

Neal Singer
nsinger@sandia.gov
505-845-7078

Media Downloads

Caption

Sandia National Laboratories researcher Mike Heroux, developer of the High Performance Conjugate Gradients program that uses complex criteria to rank supercomputers.

Credits

Photo by Randy Montoya

ALBUQUERQUE, N.M. — A software program that ranks supercomputers on their ability to solve complex problems rather than on raw speed alone continues to gain traction in the high-performance computing community.

Michael Heroux
Sandia National Laboratories researcher Mike Heroux, developer of the High Performance Conjugate Gradients program that uses complex criteria to rank supercomputers.

More than 60 supercomputers were ranked by the emerging tool, termed the High Performance Conjugate Gradients (HPCG) benchmark, in ratings released at the annual supercomputing meeting SC15 in late November. Eighteen months earlier, only 15 supercomputers were on the list.

“HPCG is designed to complement the traditional High Performance Linpack (HPL) benchmark used as the official metric for ranking the top 500 systems,” said Sandia National Laboratories researcher Mike Heroux, who developed the HPCG program in collaboration with Jack Dongarra and Piotr Luszczek from the University of Tennessee.

The current list contains the same entries as many of the top 50 systems from Linpack’s TOP500 but significantly shuffles HPL rankings, indicating that HPCG puts different system characteristics through their paces.

This is because the different measures provided by HPCG and HPL act as bookends on the performance spectrum of a given system, said Heroux. “While HPL tests supercomputer speed in solving relatively straightforward problems, HPCG’s more complex criteria test characteristics such as high-performance interconnects, memory systems and fine-grain cooperative threading that are important to a different and broader set of applications.”

Heroux said only time will tell whether supercomputer manufacturers and users gravitate toward HPCG as a useful test. “All major vendor computing companies have invested heavily in optimizing our benchmark. All participating system owners have dedicated machine time to make runs. These investments are the strongest confirmation that we have developed something useful.

“Many benchmarks have been proposed as complements or even replacements for Linpack,” he said. “We have had more success than previous efforts. But there is still a lot of work to keep the effort going.”

 

Sandia National Laboratories is a multimission laboratory operated by National Technology and Engineering Solutions of Sandia LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration. Sandia Labs has major research and development responsibilities in nuclear deterrence, global security, defense, energy technologies and economic competitiveness, with main facilities in Albuquerque, New Mexico, and Livermore, California.

Sandia news media contact

Neal Singer
nsinger@sandia.gov
505-845-7078