Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project

Addi Malviya-Thakur; Reed Milewicz; Samuel Grayson; Philip Fackler; James Belak; John A. Turner

doi:10.1109/eScience55777.2022.00084

Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project

Addi Malviya-Thakur, Reed Milewicz, Samuel Grayson, Philip Fackler, James Belak, John A. Turner

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The purpose of this study is to discuss the experiential lessons associated with adopting scientific workflows in the Exascale Additive Manufacturing project (ExaAM) through the lens of Perceived Characteristic of Innovation (PCI). Besides the implementation, the factors we considered critical to the adoption of the workflow are provenance, sustainable automation, implementation challenges, and integration/compatibility challenges. Through conversations and interviews among the program managers, project leads, and software engineers, we have developed critical insight and strategies to overcome the obstacles and augment the successful adoption and long-term use of these workflows in ExaAM and beyond. We hope our work will pave the way for others in the research community to develop and use workflows in their respective science domains.

Original language	English
Title of host publication	Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	468-474
Number of pages	7
ISBN (Electronic)	9781665461245
DOIs	https://doi.org/10.1109/eScience55777.2022.00084
State	Published - 2022
Event	18th IEEE International Conference on e-Science, eScience 2022 - Salt Lake City, United States Duration: Oct 10 2022 → Oct 14 2022

Publication series

Name	Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022

Conference

Conference	18th IEEE International Conference on e-Science, eScience 2022
Country/Territory	United States
City	Salt Lake City
Period	10/10/22 → 10/14/22

Funding

This research was supported by the Exascale Computing Project (17-SC-20-SC), a joint project of the U.S. Department of Energy’s Office of Science and National Nuclear Security Administration, responsible for delivering a capable exascale ecosystem, including software, applications, and hardware technology, to support the nation’s exascale computing imperative. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Funders	Funder number
Office of Science and National Nuclear Security Administration
U.S. Department of Energy
National Nuclear Security Administration	DE-NA0003525

Keywords

continuous integration
provenance
reproducibility
software best practices
sustainability
workflows

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/eScience55777.2022.00084

Cite this

Malviya-Thakur, A., Milewicz, R., Grayson, S., Fackler, P., Belak, J., & Turner, J. A. (2022). Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project. In Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022 (pp. 468-474). (Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/eScience55777.2022.00084

Malviya-Thakur, Addi ; Milewicz, Reed ; Grayson, Samuel et al. / Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project. Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 468-474 (Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022).

@inproceedings{494f724ac64448518019abe1d06ee2a0,

title = "Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project",

abstract = "The purpose of this study is to discuss the experiential lessons associated with adopting scientific workflows in the Exascale Additive Manufacturing project (ExaAM) through the lens of Perceived Characteristic of Innovation (PCI). Besides the implementation, the factors we considered critical to the adoption of the workflow are provenance, sustainable automation, implementation challenges, and integration/compatibility challenges. Through conversations and interviews among the program managers, project leads, and software engineers, we have developed critical insight and strategies to overcome the obstacles and augment the successful adoption and long-term use of these workflows in ExaAM and beyond. We hope our work will pave the way for others in the research community to develop and use workflows in their respective science domains.",

keywords = "continuous integration, provenance, reproducibility, software best practices, sustainability, workflows",

author = "Addi Malviya-Thakur and Reed Milewicz and Samuel Grayson and Philip Fackler and James Belak and Turner, {John A.}",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 18th IEEE International Conference on e-Science, eScience 2022 ; Conference date: 10-10-2022 Through 14-10-2022",

year = "2022",

doi = "10.1109/eScience55777.2022.00084",

language = "English",

series = "Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "468--474",

booktitle = "Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022",

}

Malviya-Thakur, A, Milewicz, R, Grayson, S, Fackler, P, Belak, J & Turner, JA 2022, Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project. in Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022. Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022, Institute of Electrical and Electronics Engineers Inc., pp. 468-474, 18th IEEE International Conference on e-Science, eScience 2022, Salt Lake City, United States, 10/10/22. https://doi.org/10.1109/eScience55777.2022.00084

Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project. / Malviya-Thakur, Addi; Milewicz, Reed; Grayson, Samuel et al.
Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 468-474 (Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project

AU - Malviya-Thakur, Addi

AU - Milewicz, Reed

AU - Grayson, Samuel

AU - Fackler, Philip

AU - Belak, James

AU - Turner, John A.

PY - 2022

Y1 - 2022

N2 - The purpose of this study is to discuss the experiential lessons associated with adopting scientific workflows in the Exascale Additive Manufacturing project (ExaAM) through the lens of Perceived Characteristic of Innovation (PCI). Besides the implementation, the factors we considered critical to the adoption of the workflow are provenance, sustainable automation, implementation challenges, and integration/compatibility challenges. Through conversations and interviews among the program managers, project leads, and software engineers, we have developed critical insight and strategies to overcome the obstacles and augment the successful adoption and long-term use of these workflows in ExaAM and beyond. We hope our work will pave the way for others in the research community to develop and use workflows in their respective science domains.

AB - The purpose of this study is to discuss the experiential lessons associated with adopting scientific workflows in the Exascale Additive Manufacturing project (ExaAM) through the lens of Perceived Characteristic of Innovation (PCI). Besides the implementation, the factors we considered critical to the adoption of the workflow are provenance, sustainable automation, implementation challenges, and integration/compatibility challenges. Through conversations and interviews among the program managers, project leads, and software engineers, we have developed critical insight and strategies to overcome the obstacles and augment the successful adoption and long-term use of these workflows in ExaAM and beyond. We hope our work will pave the way for others in the research community to develop and use workflows in their respective science domains.

KW - continuous integration

KW - provenance

KW - reproducibility

KW - software best practices

KW - sustainability

KW - workflows

UR - http://www.scopus.com/inward/record.url?scp=85145439990&partnerID=8YFLogxK

U2 - 10.1109/eScience55777.2022.00084

DO - 10.1109/eScience55777.2022.00084

M3 - Conference contribution

AN - SCOPUS:85145439990

T3 - Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022

SP - 468

EP - 474

BT - Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 18th IEEE International Conference on e-Science, eScience 2022

Y2 - 10 October 2022 through 14 October 2022

ER -

Malviya-Thakur A, Milewicz R, Grayson S, Fackler P, Belak J, Turner JA. Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project. In Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 468-474. (Proceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022). doi: 10.1109/eScience55777.2022.00084

Real-World Experiences Adopting Workflows at Exascale on the ExaAM Project

Abstract

Publication series

Conference

Funding

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this