Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Henri Casanova; Ewa Deelman; Sandra Gesing; Michael Hildreth; Stephen Hudson; William Koch; Jeffrey Larson; Mary Ann McDowell; Natalie Meyers; John Luke Navarro; George Papadimitriou; Ryan Tanaka; Ian Taylor; Douglas Thain; Stefan M. Wild; Rosa Filgueira; Rafael Ferreira Da Silva

doi:10.1109/WORKS54523.2021.00015

Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Henri Casanova, Ewa Deelman, Sandra Gesing, Michael Hildreth, Stephen Hudson, William Koch, Jeffrey Larson, Mary Ann McDowell, Natalie Meyers, John Luke Navarro, George Papadimitriou, Ryan Tanaka, Ian Taylor, Douglas Thain, Stefan M. Wild, Rosa Filgueira, Rafael Ferreira Da Silva

Data Lifecycle Technologies

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

Original language	English
Title of host publication	Proceedings of WORKS 2021
Subtitle of host publication	16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	74-80
Number of pages	7
ISBN (Electronic)	9781665411363
DOIs	https://doi.org/10.1109/WORKS54523.2021.00015
State	Published - 2021
Event	16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021 - St. Louis, United States Duration: Nov 15 2021 → …

Publication series

Name	Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference	16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021
Country/Territory	United States
City	St. Louis
Period	11/15/21 → …

Funding

Acknowledgments. This work is funded by NSF contracts #1923539 and #1923621; and partly funded by NSF contracts #2103489, and #2103508. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725. Acknowledgments. This work is funded by DOE contract #DESC0012636 and NSF contract #1664162. Acknowledgments. This work is funded by NSF contracts #2100561 and #2100636.

Keywords

Concurrent computing
Ensembles
GPU
Monitoring
Numerical optimization
Nvidia
Python
Scientific workflows
Simulation
Training and education

Access to Document

10.1109/WORKS54523.2021.00015

Cite this

Casanova, H., Deelman, E., Gesing, S., Hildreth, M., Hudson, S., Koch, W., Larson, J., McDowell, M. A., Meyers, N., Navarro, J. L., Papadimitriou, G., Tanaka, R., Taylor, I., Thain, D., Wild, S. M., Filgueira, R., & Da Silva, R. F. (2021). Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. In Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 74-80). (Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WORKS54523.2021.00015

Casanova, Henri ; Deelman, Ewa ; Gesing, Sandra et al. / Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 74-80 (Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis).

@inproceedings{4997834826414d59a9715223a9cd10ba,

title = "Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education",

abstract = "Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.",

keywords = "Concurrent computing, Ensembles, GPU, Monitoring, Numerical optimization, Nvidia, Python, Scientific workflows, Simulation, Training and education",

author = "Henri Casanova and Ewa Deelman and Sandra Gesing and Michael Hildreth and Stephen Hudson and William Koch and Jeffrey Larson and McDowell, {Mary Ann} and Natalie Meyers and Navarro, {John Luke} and George Papadimitriou and Ryan Tanaka and Ian Taylor and Douglas Thain and Wild, {Stefan M.} and Rosa Filgueira and {Da Silva}, {Rafael Ferreira}",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021 ; Conference date: 15-11-2021",

year = "2021",

doi = "10.1109/WORKS54523.2021.00015",

language = "English",

series = "Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "74--80",

booktitle = "Proceedings of WORKS 2021",

}

Casanova, H, Deelman, E, Gesing, S, Hildreth, M, Hudson, S, Koch, W, Larson, J, McDowell, MA, Meyers, N, Navarro, JL, Papadimitriou, G, Tanaka, R, Taylor, I, Thain, D, Wild, SM, Filgueira, R & Da Silva, RF 2021, Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. in Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis. Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis, Institute of Electrical and Electronics Engineers Inc., pp. 74-80, 16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021, St. Louis, United States, 11/15/21. https://doi.org/10.1109/WORKS54523.2021.00015

Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. / Casanova, Henri; Deelman, Ewa; Gesing, Sandra et al.
Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2021. p. 74-80 (Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

AU - Casanova, Henri

AU - Deelman, Ewa

AU - Gesing, Sandra

AU - Hildreth, Michael

AU - Hudson, Stephen

AU - Koch, William

AU - Larson, Jeffrey

AU - McDowell, Mary Ann

AU - Meyers, Natalie

AU - Navarro, John Luke

AU - Papadimitriou, George

AU - Tanaka, Ryan

AU - Taylor, Ian

AU - Thain, Douglas

AU - Wild, Stefan M.

AU - Filgueira, Rosa

AU - Da Silva, Rafael Ferreira

PY - 2021

Y1 - 2021

N2 - Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

AB - Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

KW - Concurrent computing

KW - Ensembles

KW - GPU

KW - Monitoring

KW - Numerical optimization

KW - Nvidia

KW - Python

KW - Scientific workflows

KW - Simulation

KW - Training and education

UR - http://www.scopus.com/inward/record.url?scp=85124560211&partnerID=8YFLogxK

U2 - 10.1109/WORKS54523.2021.00015

DO - 10.1109/WORKS54523.2021.00015

M3 - Conference contribution

AN - SCOPUS:85124560211

T3 - Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis

SP - 74

EP - 80

BT - Proceedings of WORKS 2021

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021

Y2 - 15 November 2021

ER -

Casanova H, Deelman E, Gesing S, Hildreth M, Hudson S, Koch W et al. Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. In Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc. 2021. p. 74-80. (Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis). doi: 10.1109/WORKS54523.2021.00015

Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this