The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science

Eric Suchyta; Scott Klasky; Norbert Podhorszki; Matthew Wolf; Abolaji Adesoji; C. S. Chang; Jong Choi; Philip E. Davis; Julien Dominski; Stéphane Ethier; Ian Foster; Kai Germaschewski; Berk Geveci; Chris Harris; Kevin A. Huck; Qing Liu; Jeremy Logan; Kshitij Mehta; Gabriele Merlo; Shirley V. Moore; Todd Munson; Manish Parashar; David Pugmire; Mark S. Shephard; Cameron W. Smith; Pradeep Subedi; Lipeng Wan; Ruonan Wang; Shuangxi Zhang

doi:10.1177/10943420211019119

The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science

Eric Suchyta, Scott Klasky, Norbert Podhorszki, Matthew Wolf, Abolaji Adesoji, C. S. Chang, Jong Choi, Philip E. Davis, Julien Dominski, Stéphane Ethier, Ian Foster, Kai Germaschewski, Berk Geveci, Chris Harris, Kevin A. Huck, Qing Liu, Jeremy Logan, Kshitij Mehta, Gabriele Merlo, Shirley V. MooreTodd Munson, Manish Parashar, David Pugmire, Mark S. Shephard, Cameron W. Smith, Pradeep Subedi, Lipeng Wan, Ruonan Wang, Shuangxi Zhang

Research output: Contribution to journal › Article › peer-review

16 Scopus citations

Abstract

We present the Exascale Framework for High Fidelity coupled Simulations (EFFIS), a workflow and code coupling framework developed as part of the Whole Device Modeling Application (WDMApp) in the Exascale Computing Project. EFFIS consists of a library, command line utilities, and a collection of run-time daemons. Together, these software products enable users to easily compose and execute workflows that include: strong or weak coupling, in situ (or offline) analysis/visualization/monitoring, command-and-control actions, remote dashboard integration, and more. We describe WDMApp physics coupling cases and computer science requirements that motivate the design of the EFFIS framework. Furthermore, we explain the essential enabling technology that EFFIS leverages: ADIOS for performant data movement, PerfStubs/TAU for performance monitoring, and an advanced COUPLER for transforming coupling data from its native format to the representation needed by another application. Finally, we demonstrate EFFIS using coupled multi-simulation WDMApp workflows and exemplify how the framework supports the project’s needs. We show that EFFIS and its associated services for data movement, visualization, and performance collection does not introduce appreciable overhead to the WDMApp workflow and that the resource-dominant application’s idle time while waiting for data is minimal.

Original language	English
Pages (from-to)	106-128
Number of pages	23
Journal	International Journal of High Performance Computing Applications
Volume	36
Issue number	1
DOIs	https://doi.org/10.1177/10943420211019119
State	Published - Jan 2022

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by the Exascale Computing Project (17-SC-20-SC), a collaborative effort of the U.S. Department of Energy Office of Science and National Nuclear Security Administration. It used resources of the Oak Ridge Leadership Computing Facility, a DOE Office of Science User Facility supported under Contract DE-AC05-00OR22725.

Funders	Funder number
U.S. Department of Energy Office of Science and National Nuclear Security Administration
Office of Science	DE-AC05-00OR22725

Keywords

ECP
Workflows
code coupling
in situ
whole device modeling

Access to Document

10.1177/10943420211019119

Cite this

Suchyta, E., Klasky, S., Podhorszki, N., Wolf, M., Adesoji, A., Chang, C. S., Choi, J., Davis, P. E., Dominski, J., Ethier, S., Foster, I., Germaschewski, K., Geveci, B., Harris, C., Huck, K. A., Liu, Q., Logan, J., Mehta, K., Merlo, G., ... Zhang, S. (2022). The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science. International Journal of High Performance Computing Applications, 36(1), 106-128. https://doi.org/10.1177/10943420211019119

@article{9d6b8f29b0b6477694df629bbadd703d,

title = "The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science",

abstract = "We present the Exascale Framework for High Fidelity coupled Simulations (EFFIS), a workflow and code coupling framework developed as part of the Whole Device Modeling Application (WDMApp) in the Exascale Computing Project. EFFIS consists of a library, command line utilities, and a collection of run-time daemons. Together, these software products enable users to easily compose and execute workflows that include: strong or weak coupling, in situ (or offline) analysis/visualization/monitoring, command-and-control actions, remote dashboard integration, and more. We describe WDMApp physics coupling cases and computer science requirements that motivate the design of the EFFIS framework. Furthermore, we explain the essential enabling technology that EFFIS leverages: ADIOS for performant data movement, PerfStubs/TAU for performance monitoring, and an advanced COUPLER for transforming coupling data from its native format to the representation needed by another application. Finally, we demonstrate EFFIS using coupled multi-simulation WDMApp workflows and exemplify how the framework supports the project{\textquoteright}s needs. We show that EFFIS and its associated services for data movement, visualization, and performance collection does not introduce appreciable overhead to the WDMApp workflow and that the resource-dominant application{\textquoteright}s idle time while waiting for data is minimal.",

keywords = "ECP, Workflows, code coupling, in situ, whole device modeling",

author = "Eric Suchyta and Scott Klasky and Norbert Podhorszki and Matthew Wolf and Abolaji Adesoji and Chang, {C. S.} and Jong Choi and Davis, {Philip E.} and Julien Dominski and St{\'e}phane Ethier and Ian Foster and Kai Germaschewski and Berk Geveci and Chris Harris and Huck, {Kevin A.} and Qing Liu and Jeremy Logan and Kshitij Mehta and Gabriele Merlo and Moore, {Shirley V.} and Todd Munson and Manish Parashar and David Pugmire and Shephard, {Mark S.} and Smith, {Cameron W.} and Pradeep Subedi and Lipeng Wan and Ruonan Wang and Shuangxi Zhang",

note = "Publisher Copyright: {\textcopyright} The Author(s) 2021.",

year = "2022",

month = jan,

doi = "10.1177/10943420211019119",

language = "English",

volume = "36",

pages = "106--128",

journal = "International Journal of High Performance Computing Applications",

issn = "1094-3420",

publisher = "SAGE Publications",

number = "1",

}

Suchyta, E , Klasky, S , Podhorszki, N, Wolf, M, Adesoji, A, Chang, CS, Choi, J, Davis, PE, Dominski, J, Ethier, S, Foster, I, Germaschewski, K, Geveci, B, Harris, C, Huck, KA, Liu, Q, Logan, J , Mehta, K, Merlo, G, Moore, SV, Munson, T, Parashar, M, Pugmire, D, Shephard, MS, Smith, CW, Subedi, P, Wan, L, Wang, R & Zhang, S 2022, 'The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science', International Journal of High Performance Computing Applications, vol. 36, no. 1, pp. 106-128. https://doi.org/10.1177/10943420211019119

TY - JOUR

T1 - The Exascale Framework for High Fidelity coupled Simulations (EFFIS)

T2 - Enabling whole device modeling in fusion science

AU - Suchyta, Eric

AU - Klasky, Scott

AU - Podhorszki, Norbert

AU - Wolf, Matthew

AU - Adesoji, Abolaji

AU - Chang, C. S.

AU - Choi, Jong

AU - Davis, Philip E.

AU - Dominski, Julien

AU - Ethier, Stéphane

AU - Foster, Ian

AU - Germaschewski, Kai

AU - Geveci, Berk

AU - Harris, Chris

AU - Huck, Kevin A.

AU - Liu, Qing

AU - Logan, Jeremy

AU - Mehta, Kshitij

AU - Merlo, Gabriele

AU - Moore, Shirley V.

AU - Munson, Todd

AU - Parashar, Manish

AU - Pugmire, David

AU - Shephard, Mark S.

AU - Smith, Cameron W.

AU - Subedi, Pradeep

AU - Wan, Lipeng

AU - Wang, Ruonan

AU - Zhang, Shuangxi

PY - 2022/1

Y1 - 2022/1

N2 - We present the Exascale Framework for High Fidelity coupled Simulations (EFFIS), a workflow and code coupling framework developed as part of the Whole Device Modeling Application (WDMApp) in the Exascale Computing Project. EFFIS consists of a library, command line utilities, and a collection of run-time daemons. Together, these software products enable users to easily compose and execute workflows that include: strong or weak coupling, in situ (or offline) analysis/visualization/monitoring, command-and-control actions, remote dashboard integration, and more. We describe WDMApp physics coupling cases and computer science requirements that motivate the design of the EFFIS framework. Furthermore, we explain the essential enabling technology that EFFIS leverages: ADIOS for performant data movement, PerfStubs/TAU for performance monitoring, and an advanced COUPLER for transforming coupling data from its native format to the representation needed by another application. Finally, we demonstrate EFFIS using coupled multi-simulation WDMApp workflows and exemplify how the framework supports the project’s needs. We show that EFFIS and its associated services for data movement, visualization, and performance collection does not introduce appreciable overhead to the WDMApp workflow and that the resource-dominant application’s idle time while waiting for data is minimal.

AB - We present the Exascale Framework for High Fidelity coupled Simulations (EFFIS), a workflow and code coupling framework developed as part of the Whole Device Modeling Application (WDMApp) in the Exascale Computing Project. EFFIS consists of a library, command line utilities, and a collection of run-time daemons. Together, these software products enable users to easily compose and execute workflows that include: strong or weak coupling, in situ (or offline) analysis/visualization/monitoring, command-and-control actions, remote dashboard integration, and more. We describe WDMApp physics coupling cases and computer science requirements that motivate the design of the EFFIS framework. Furthermore, we explain the essential enabling technology that EFFIS leverages: ADIOS for performant data movement, PerfStubs/TAU for performance monitoring, and an advanced COUPLER for transforming coupling data from its native format to the representation needed by another application. Finally, we demonstrate EFFIS using coupled multi-simulation WDMApp workflows and exemplify how the framework supports the project’s needs. We show that EFFIS and its associated services for data movement, visualization, and performance collection does not introduce appreciable overhead to the WDMApp workflow and that the resource-dominant application’s idle time while waiting for data is minimal.

KW - ECP

KW - Workflows

KW - code coupling

KW - in situ

KW - whole device modeling

UR - http://www.scopus.com/inward/record.url?scp=85106441886&partnerID=8YFLogxK

U2 - 10.1177/10943420211019119

DO - 10.1177/10943420211019119

M3 - Article

AN - SCOPUS:85106441886

SN - 1094-3420

VL - 36

SP - 106

EP - 128

JO - International Journal of High Performance Computing Applications

JF - International Journal of High Performance Computing Applications

IS - 1

ER -

The Exascale Framework for High Fidelity coupled Simulations (EFFIS): Enabling whole device modeling in fusion science

Abstract

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this