Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer

Scott Atchley; Chris Zimmer; John R. Lange; David E. Bernholdt; Veronica G. Melesse Vergara; Thomas Beck; Michael J. Brim; Reuben Budiardja; Sunita Chandrasekaran; Markus Eisenbach; Thomas Evans; Matthew Ezell; Nicholas Frontiere; Antigoni Georgiadou; Joe Glenski; Philipp Grete; Steven Hamilton; John Holmen; Axel Huebl; Daniel Jacobson; Wayne Joubert; Kim McMahon; Elia Merzari; Stan G. Moore; Andrew Myers; Stephen Nichols; Sarp Oral; Thomas Papatheodore; Danny Perez; David M. Rogers; Evan Schneider; Jean Luc Vay; P. K. Yeung

doi:10.1145/3581784.3607089

Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer

Scott Atchley, Chris Zimmer, John R. Lange, David E. Bernholdt, Veronica G. Melesse Vergara, Thomas Beck, Michael J. Brim, Reuben Budiardja, Sunita Chandrasekaran, Markus Eisenbach, Thomas Evans, Matthew Ezell, Nicholas Frontiere, Antigoni Georgiadou, Joe Glenski, Philipp Grete, Steven Hamilton, John Holmen, Axel Huebl, Daniel JacobsonWayne Joubert, Kim McMahon, Elia Merzari, Stan G. Moore, Andrew Myers, Stephen Nichols, Sarp Oral, Thomas Papatheodore, Danny Perez, David M. Rogers, Evan Schneider, Jean Luc Vay, P. K. Yeung

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

As the US Department of Energy (DOE) computing facilities began deploying petascale systems in 2008, DOE was already setting its sights on exascale. In that year, DARPA published a report on the feasibility of reaching exascale. The report authors identified several key challenges in the pursuit of exascale including power, memory, concurrency, and resiliency. That report informed the DOE's computing strategy for reaching exascale. With the deployment of Oak Ridge National Laboratory's Frontier supercomputer, we have officially entered the exascale era. In this paper, we discuss Frontier's architecture, how it addresses those challenges, and describe some early application results from Oak Ridge Leadership Computing Facility's Center of Excellence and the Exascale Computing Project.

Original language	English
Title of host publication	SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis
Publisher	IEEE Computer Society
ISBN (Electronic)	9798400701092
DOIs	https://doi.org/10.1145/3581784.3607089
State	Published - 2023
Event	2023 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2023 - Denver, United States Duration: Nov 12 2023 → Nov 17 2023

Publication series

Name	International Conference for High Performance Computing, Networking, Storage and Analysis, SC
ISSN (Print)	2167-4329
ISSN (Electronic)	2167-4337

Conference

Conference	2023 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2023
Country/Territory	United States
City	Denver
Period	11/12/23 → 11/17/23

Funding

The authors gratefully acknowledge our colleagues and collaborators at ORNL, HPE, and AMD. Deploying leadership HPC systems requires an army of dedicated professionals and we are privileged to be able to work with them. This manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan). We acknowledge all WarpX contributors, which are primarily with LBNL, LLNL, CEA-LIDYL, SLAC, DESY, CERN, and TAE. Luca Fedeli and Henri Vincenti contributed significantly to the presented Frontier results together with co-authors of [16]. WarpX co-authors want to highlight the leading contributions of Weiqun Zhang, Remi Lehe, Maxence Thevenet. This research was supported by the Exascale Computing Project (17-SC-20-SC), a joint project of the U.S. Department of Energy's Office of Science and National Nuclear Security Administration, responsible for delivering a capable exascale ecosystem, including software, applications, and hardware technology, to support the nation's exascale computing imperative. This material is based upon work supported by the CAMPA collaboration, a project of the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research and Office of High Energy Physics, Scientific Discovery through Advanced Computing (SciDAC) program. This work was supported by the Laboratory Directed Research and Development Program of Lawrence Berkeley National Laboratory under U.S. Department of Energy Contract No. DE-AC02-05CH11231 and by LLNL under Contract DE-AC52-07NA27344. This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 101030214.

Funders	Funder number
High Energy Physics
DOE Public Access Plan
Advanced Scientific Computing Research
U.S. Department of Energy
Office of Science
CERN
Office of Science and National Nuclear Security Administration
Horizon 2020
Oak Ridge National Laboratory	DE-AC05-00OR22725
Laboratory Directed Research and Development	DE-AC02-05CH11231
H2020 Marie Skłodowska-Curie Actions	101030214
TAE	17-SC-20-SC
Lawrence Livermore National Laboratory	DE-AC52-07NA27344

Access to Document

10.1145/3581784.3607089

Cite this

Atchley, S., Zimmer, C., Lange, J. R., Bernholdt, D. E., Melesse Vergara, V. G., Beck, T., Brim, M. J., Budiardja, R., Chandrasekaran, S., Eisenbach, M., Evans, T., Ezell, M., Frontiere, N., Georgiadou, A., Glenski, J., Grete, P., Hamilton, S., Holmen, J., Huebl, A., ... Yeung, P. K. (2023). Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer. In SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). IEEE Computer Society. https://doi.org/10.1145/3581784.3607089

Atchley, Scott ; Zimmer, Chris ; Lange, John R. et al. / Frontier : Exploring Exascale The System Architecture of the First Exascale Supercomputer. SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society, 2023. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).

@inproceedings{064900a098d245099cb1529c53e3fa00,

title = "Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer",

abstract = "As the US Department of Energy (DOE) computing facilities began deploying petascale systems in 2008, DOE was already setting its sights on exascale. In that year, DARPA published a report on the feasibility of reaching exascale. The report authors identified several key challenges in the pursuit of exascale including power, memory, concurrency, and resiliency. That report informed the DOE's computing strategy for reaching exascale. With the deployment of Oak Ridge National Laboratory's Frontier supercomputer, we have officially entered the exascale era. In this paper, we discuss Frontier's architecture, how it addresses those challenges, and describe some early application results from Oak Ridge Leadership Computing Facility's Center of Excellence and the Exascale Computing Project.",

author = "Scott Atchley and Chris Zimmer and Lange, {John R.} and Bernholdt, {David E.} and {Melesse Vergara}, {Veronica G.} and Thomas Beck and Brim, {Michael J.} and Reuben Budiardja and Sunita Chandrasekaran and Markus Eisenbach and Thomas Evans and Matthew Ezell and Nicholas Frontiere and Antigoni Georgiadou and Joe Glenski and Philipp Grete and Steven Hamilton and John Holmen and Axel Huebl and Daniel Jacobson and Wayne Joubert and Kim McMahon and Elia Merzari and Moore, {Stan G.} and Andrew Myers and Stephen Nichols and Sarp Oral and Thomas Papatheodore and Danny Perez and Rogers, {David M.} and Evan Schneider and Vay, {Jean Luc} and Yeung, {P. K.}",

note = "Publisher Copyright: {\textcopyright} 2023 ACM.; 2023 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2023 ; Conference date: 12-11-2023 Through 17-11-2023",

year = "2023",

doi = "10.1145/3581784.3607089",

language = "English",

series = "International Conference for High Performance Computing, Networking, Storage and Analysis, SC",

publisher = "IEEE Computer Society",

booktitle = "SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis",

}

Atchley, S , Zimmer, C, Lange, JR, Bernholdt, DE, Melesse Vergara, VG, Beck, T , Brim, MJ , Budiardja, R, Chandrasekaran, S, Eisenbach, M , Evans, T , Ezell, M, Frontiere, N, Georgiadou, A, Glenski, J, Grete, P, Hamilton, S, Holmen, J, Huebl, A, Jacobson, D, Joubert, W, McMahon, K, Merzari, E, Moore, SG, Myers, A, Nichols, S , Oral, S, Papatheodore, T, Perez, D, Rogers, DM, Schneider, E, Vay, JL & Yeung, PK 2023, Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer. in SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis. International Conference for High Performance Computing, Networking, Storage and Analysis, SC, IEEE Computer Society, 2023 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2023, Denver, United States, 11/12/23. https://doi.org/10.1145/3581784.3607089

Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer. / Atchley, Scott ; Zimmer, Chris; Lange, John R. et al.
SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society, 2023. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Frontier

T2 - 2023 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2023

AU - Atchley, Scott

AU - Zimmer, Chris

AU - Lange, John R.

AU - Bernholdt, David E.

AU - Melesse Vergara, Veronica G.

AU - Beck, Thomas

AU - Brim, Michael J.

AU - Budiardja, Reuben

AU - Chandrasekaran, Sunita

AU - Eisenbach, Markus

AU - Evans, Thomas

AU - Ezell, Matthew

AU - Frontiere, Nicholas

AU - Georgiadou, Antigoni

AU - Glenski, Joe

AU - Grete, Philipp

AU - Hamilton, Steven

AU - Holmen, John

AU - Huebl, Axel

AU - Jacobson, Daniel

AU - Joubert, Wayne

AU - McMahon, Kim

AU - Merzari, Elia

AU - Moore, Stan G.

AU - Myers, Andrew

AU - Nichols, Stephen

AU - Oral, Sarp

AU - Papatheodore, Thomas

AU - Perez, Danny

AU - Rogers, David M.

AU - Schneider, Evan

AU - Vay, Jean Luc

AU - Yeung, P. K.

PY - 2023

Y1 - 2023

N2 - As the US Department of Energy (DOE) computing facilities began deploying petascale systems in 2008, DOE was already setting its sights on exascale. In that year, DARPA published a report on the feasibility of reaching exascale. The report authors identified several key challenges in the pursuit of exascale including power, memory, concurrency, and resiliency. That report informed the DOE's computing strategy for reaching exascale. With the deployment of Oak Ridge National Laboratory's Frontier supercomputer, we have officially entered the exascale era. In this paper, we discuss Frontier's architecture, how it addresses those challenges, and describe some early application results from Oak Ridge Leadership Computing Facility's Center of Excellence and the Exascale Computing Project.

AB - As the US Department of Energy (DOE) computing facilities began deploying petascale systems in 2008, DOE was already setting its sights on exascale. In that year, DARPA published a report on the feasibility of reaching exascale. The report authors identified several key challenges in the pursuit of exascale including power, memory, concurrency, and resiliency. That report informed the DOE's computing strategy for reaching exascale. With the deployment of Oak Ridge National Laboratory's Frontier supercomputer, we have officially entered the exascale era. In this paper, we discuss Frontier's architecture, how it addresses those challenges, and describe some early application results from Oak Ridge Leadership Computing Facility's Center of Excellence and the Exascale Computing Project.

UR - http://www.scopus.com/inward/record.url?scp=85190477584&partnerID=8YFLogxK

U2 - 10.1145/3581784.3607089

DO - 10.1145/3581784.3607089

M3 - Conference contribution

AN - SCOPUS:85190477584

T3 - International Conference for High Performance Computing, Networking, Storage and Analysis, SC

BT - SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis

PB - IEEE Computer Society

Y2 - 12 November 2023 through 17 November 2023

ER -

Atchley S , Zimmer C, Lange JR, Bernholdt DE, Melesse Vergara VG, Beck T et al. Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer. In SC 2023 - International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society. 2023. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). doi: 10.1145/3581784.3607089

Frontier: Exploring Exascale The System Architecture of the First Exascale Supercomputer

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this