Tag Archives: Lawrence Livermore National Laboratory

Exascale Computing is at the Doorstep

Updated 7 April 2020

Peter Lobner

The best current supercomputers are “petascale” machines.  This term refers to supercomputers capable of performing at least 1.0 petaflops [PFLOPS; 1015  floating-point operations per second (FLOPS)], and also refers to data storage systems capable of storing at least 1.0 petabyte (PB; 1015  bytes) of data.

In my 13 November 2018 post, I reported the latest TOP500 ranking of the world’s fastest supercomputers.  The new leaders were two US supercomputers: Summit and Sierra. A year later, in November 2019, they remained at the top of the TOP500 ranking.

  • Summit:  The #1 ranked IBM Summit is installed at the Department of Energy’s (DOE) Oak Ridge National Laboratory (ORNL) in Tennessee.  It has a LINPACK Benchmark Rmax (maximal achieved performance) rating of 148.6 PFLOPS (1.486 x 1017  FLOPS) and an Rpeak (theoretical peak performance) rating of 200.8 PFLOPS. Summit’s peak electric power demand is 10.01 MW (megawatts).
  • Sierra:The #2 ranked IBM Sierra is installed at the DOE’s Lawrence Livermore National Laboratory (LLNL) in California. It has an Rmax rating of 94.64 PFLOPS (0.9464 x 1017  FLOPS) and an Rpeak rating of 125.7 PFLOPS. Sierra’s peak electric power demand is 7.44 MW.

The next update of the TOP500 ranking will be in June 2020.  Check out their website here to see if the rankings change:   http:// https://www.top500.org

New exascale machines are only a year or two away

The next big step up in supercomputing power will be the arrival of “exascale” machines, which refers to supercomputers capable of performing at least 1.0 exaflops (EFLOPS; 1018  FLOPS), and also refers to data storage systems capable of storing at least 1.0 exabyte (EB, 1018  bytes) of data.  As you might suspect, there is intense international completion to be the first nation to operate an exascale supercomputer.  The main players are the US, China and Japan.

In the US, DOE awarded contracts to build three new exascale supercomputers: 

  • Aurora, announced in March 2019
  • Frontier, announced in May 2019
  • El Capitan, announced in March 2020

In this post, we’ll take a look at these three new supercomputers, each of which will be about ten times faster than the existing TOP500 leaders, Summit and Sierra.

Aurora supercomputer for ANL

The Aurora supercomputer is being built at Argonne National Laboratory (ANL) by the team of Intel (prime contractor) and Cray (subcontractor), under a contract valued at more than $500 million. 

Aurora supercomputer concept drawing.
Source: DOE / Argonne National Laboratory

The computer architecture is based on the Cray “Shasta” system and Intel’s Xeon Scalable processor, Xe compute architecture, Optane Datacenter Persistent Memory, and One API software. Those Cray and Intel technologies will be integrated into more than 200 Shasta cabinets, all connected by Cray’s Slingshot interconnect and associated software stack. 

Aurora is expected to come online by the end of 2021 and likely will be the first exascale supercomputer in the US.  It is being designed for sustained performance of one exaflops.  An Argonne spokesman stated, “This platform is designed to tackle the largest AI (artificial intelligence) training and inference problems that we know about.”

For more information on the Aurora supercomputer, see the 18 March 2019 ANL press release here:  https://www.anl.gov/article/us-department-of-energy-and-intel-to-deliver-first-exascale-supercomputer

Frontier supercomputer for ORNL

The Frontier supercomputer is being built by at ORNL by the team of Cray (prime contractor) and Advanced Micro Devices, Inc. (AMD, subcontractor), under a contract valued at about $600 million. 

Frontier supercomputer concept drawing.
Source:  DOE / Oak Ridge National Laboratory

The computer architecture is based on the Cray “Shasta” system and will consist of more than 100 Cray Shasta cabinets with high density “compute blades” that support a 4:1 GPU to CPU ratio using AMD EPYC processors (CPUs) and Radeon Instinct GPU accelerators purpose-built for the needs of exascale computing. Cray and AMD are co-designing and developing enhanced GPU programming tools.  

Frontier is expected to come online in 2022 after Aurora, but is expected to be more powerful, with a rating of 1.5 exaflops. Frontier will find applications in deep learning, machine learning and data analytics for applications ranging from manufacturing to human health.

For more information on the Frontier supercomputer, see the 7 May 2019 ORNL press release here:  https://www.ornl.gov/news/us-department-energy-and-cray-deliver-record-setting-frontier-supercomputer-ornl

El Capitan supercomputer for NNSA Labs

The El Capitan supercomputer, announced in March 2020, will be built at LLNL by the team of Hewlett Packard Enterprise (HPE) and AMD under a $600 million contract.  El Capitan is funded by the DOE’s National Nuclear Security Administration (NNSA) under their Advanced Simulation and Computing (ASC) program.  The primary users will be the three NNSA laboratories:  LLNL, Sandia National Laboratories and Los Alamos National Laboratory.  El Capitan will be used to perform complex predictive modeling and simulation to support NNSA’s nuclear weapons life extension programs (LEPs), which address aging weapons management, stockpile modernization and other matters.  

El Capitan supercomputer concept drawing.
Source:  Hewlett Packard Enterprise

El Capitan’s peak performance is expected to exceed 2 exaflops, making it about twice as fast as Aurora and about 30% faster than Frontier.

LLNL describes the El Capitan hardware as follows:  “El Capitan will be powered by next-generation AMD EPYC processors, code-named ‘Genoa’ and featuring the ‘Zen 4’ processor core, next-generation AMD Radeon Instinct GPUs based on a new compute-optimized architecture for workloads including HPC and AI, and the AMD Radeon Open Compute platform (ROCm) heterogeneous computing software.”  

NNSA’s El Capitan is expected to come online in 2023 at LLNL, about a year after ANL’s Aurora and ORNL’s Frontier.For more information on the El Capitan supercomputer, see the 5 March 2020 LLNL press release here:  https://www.llnl.gov/news/llnl-and-hpe-partner-amd-el-capitan-projected-worlds-fastest-supercomputer

Hewlett Packard Enterprise acquires Cray in May 2019

On 17 May 2019, Hewlett Packard Enterprise (HPE) announced that it has acquired Cray, Inc. for about $1.3 billion.  The following charts from the November 2018 TOP500 report gives some interesting insight into HPE’s rationale for acquiring Cray.  In the Vendor’s System Share chart, both HPE and Cray have a 9 – 9.6% share of the market based on the number of installed TOP500 systems.  In the Vendor’s Performance Share chart, the aggregate installed performance of Cray systems far exceeds the aggregate performance of a similar number of lower-end HPE systems (25.5% vs. 7.3%).  The Cray product line fits above the existing HPE product line, and the acquisition of Cray should enable HPE to compete directly with IBM in the supercomputer market.  HPE reported that it sees a growing market for exascale computing. The primary US customers are government laboratories.

The March 2020 award of NNSA’s El Capitan supercomputer to the HPE and AMD team seems to indicate that HPE made a good decision in their 2019 acquisition of Cray.

TOP500 ranking of supercomputer vendors, Nov 2018
Source:  https://www.top500.org
 

Meanwhile in China:

On 19 May 2019, the South China Morning Post reported that China is making a multi-billion dollar investment to re-take the lead in supercomputer power.  In the near-term (possibly in 2019), the newest Shuguang supercomputers are expected to operate about 50% faster than the US Summit supercomputer. This should put the new Chinese super computers in the Rmax = 210 – 250 PFLOPS range. 

In addition, China is expected to have its own exascale supercomputer operating in 2020, a year ahead of the first US exascale machine, with most, if not all, of the hardware and software being developed in China.  This computer will be installed at the Center of the Chinese Academy of Sciences (CAS) in Beijing.

You’ll find a description of China’s three exascale prototypes installed in 2018 and a synopsis of what is known about the first exascale machine on the TOP500 website at the following link: https://www.top500.org/news/china-spills-details-on-exascale-prototypes/

Where to next?

Why, zettascale, of course.  These will be supercomputers performing at least 1.0 zettaflops (ZFLOPS; 1021  FLOPS), while consuming about 100 megawatts (MW) of electrical power.

Check out the December 2018 article by Tiffany Trader, “Zettascale by 2035? China thinks so,” at the following link: https://www.hpcwire.com/2018/12/06/zettascale-by-2035/

Two US Supercomputers are Ranked Fastest in the World

Peter Lobner

In previous posts on 24 May 2015 and 28 June 2016, I reported on the TOP500 rankings of the world’s supercomputers.

In June 2013, China’s Tianhe-2 supercomputer at the National Supercomputer Center in Guangzho topped this this worldwide ranking with an Rmax Linpack score of 33 petaflops (1 petaflops = 1015  floating-point operations per second) and retained the first place position for two years. In June 2016, the new leader was another Chinese supercomputer, the Sunway TaihuLight at the National Supercomputer Center in Wuxi. TaihuLight delivered an Rmax Linpack score of 93 petaflops and remained at the top of the worldwide ranking for two years, until it was eclipsed in June 2018 by the US Summit supercomputer, then with an Rmax rating of 122.3 petaflops.

In the latest TOP500 ranking, the new leaders are two US supercomputers:  Summit (#1) and Sierra (#2).

Summit supercomputer.  Source: NVIDIA

The IBM Summit improved its past Linpack score to achieve an Rmax of 143.5 petaflops in the current ranking.  Summit is located at the Department of Energy (DOE) Oak Ridge National Laboratory (ORNL) in Tennessee.

  • 2,397,824 cores
  • 873 megawatts peak power

Sierra supercomputer. Source:  Lawrence Livermore National Laboratory / Randy Wong

The IBM Sierra also improved its past Linpack score to achieve an Rmax of 94.64 petaflops / second and move into second place, marginally ahead of China’s TaihuLight.  Sierra is located at the DOE Lawrence Livermore National Laboratory (LLNL) in California.

  • 1,572,480 cores
  • 438 megawatts peak power

The Summit and Sierra supercomputer cores are IBM POWER9 central processing units (CPUs) and NVIDIA V100 graphic processing units (GPUs).   NVIDIA claims that its GPUs are delivering 95% of Summit’s performance. Both supercomputers use a Linux operating system.

China’s Sunway TaihuLight was ranked 3rd, and Tianhe-2A was ranked 4th.  A total of five DOE supercomputers were in the top 10 positions.

You’ll find the complete 52ndedition (November 2018) TOP500 ranking here:

https://www.top500.org/lists/2018/11/

20 February 2019 Update:  Los Alamos National Laboratory (LANL) plans new supercomputer

The TOP500 ranking places LANL’s Trinity supercomputer (a Cray XC40) as the #6 fastest supercomputer in the world, but its performance (Rmax of 20.16 petaflops) is far below that of the #1 Summit supercomputer at Oak Ridge national Laboratory and the #2 Sierra supercomputer at Lawrence Livermore National Laboratory.

Source:  LANL

Not to be outdone, LANL issued a request for proposal (RFP) in February 2019 for a new supercomputer, to be named Crossroads, to support the lab’s missions for the National Nuclear Security Administration (NNSA).  A LANL spokesperson reported that, “High performance computing across the NNSA complex is used to assure the safety, security and effectiveness of the U.S. nuclear deterrent; to analyze and predict the performance, safety, and reliability of nuclear weapons and certify their functionality.”  Responses to the RFP are due by 18 March 2019.  Crossroads is expected to go online in 2021.

Many LLNL Atmospheric Nuclear Test Videos Declassified

Peter Lobner

Lawrence Livermore National Laboratory (LLNL) has posted 64 declassified videos of nuclear weapons tests on YouTube. LLNL reports:

“The U.S. conducted 210 atmospheric nuclear tests between 1945 and 1962, with multiple cameras capturing each event at around 2,400 frames per second. But in the decades since, around 10,000 of these films sat idle, scattered across the country in high-security vaults. Not only were they gathering dust, the film material itself was slowly decomposing, bringing the data they contained to the brink of being lost forever.

For the past five years, Lawrence Livermore National Laboratory (LLNL) weapon physicist Greg Spriggs and a crack team of film experts, archivists and software developers have been on a mission to hunt down, scan, reanalyze and declassify these decomposing films. The goals are to preserve the films’ content before it’s lost forever, and provide better data to the post-testing-era scientists who use computer codes to help certify that the aging U.S. nuclear deterrent remains safe, secure and effective.”

Operation Hardtack-1 – Nutmeg 51538. Source: LLNL

Here’s the link:

https://www.youtube.com/playlist?list=PLvGO_dWo8VfcmG166wKRy5z-GlJ_OQND5

Update 7 July 2018:

LLNL has posted more than 250 declassified videos of nuclear weapons tests on YouTube.  The newly digitized videos document several of the U.S. government’s 210 nuclear weapons tests carried out between 1945 and 1962.  You’ll find these videos at the following link:

https://www.youtube.com/user/LivermoreLab/videos