Workflow automation for processing Plasma fusion Simulation data

Norbert Podhorszki; Bertram Ludäscher; Scott A. Klasky

doi:10.1145/1273360.1273368

Workflow automation for processing Plasma fusion Simulation data

Norbert Podhorszki, Bertram Ludäscher, Scott A. Klasky

Workflow Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

The Center for Plasma Edge Simulation project aims to automate simulation monitoring, data processing, and result archival using scientific workflows. We describe these tasks and requirements, and the newly developed Kepler workflow components that provide the required functionality for our automated workflow solution. Besides functionality, the focus is on the robust execution of the workflow. To this end, a user-level checkpointing model has been developed that allows a workflow to restart and re-execute operations that failed during a previous run.

Original language	English
Title of host publication	WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007
Publisher	Association for Computing Machinery, Inc
Pages	35-44
Number of pages	10
ISBN (Electronic)	9781595937155
DOIs	https://doi.org/10.1145/1273360.1273368
State	Published - Jun 25 2007
Event	2nd Workshop on Workflows in Support of Large-Scale Science, WORKS 2007 - Monterey, United States Duration: Jun 25 2007 → …

Publication series

Name	WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007

Conference

Conference	2nd Workshop on Workflows in Support of Large-Scale Science, WORKS 2007
Country/Territory	United States
City	Monterey
Period	06/25/07 → …

Funding

∗Work supported by DOE grants DE-FC02-01ER25486 (Sci-DAC/SDM) and DE-AC02-05CH11231 (CPES)

Funders	Funder number
CPES
U.S. Department of Energy	DE-AC02-05CH11231, DE-FC02-01ER25486

Keywords

Checkpointing
Kepler
Plasma fusion
SSH
Scientific workflow

Access to Document

10.1145/1273360.1273368

Cite this

Podhorszki, N., Ludäscher, B., & Klasky, S. A. (2007). Workflow automation for processing Plasma fusion Simulation data. In WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007 (pp. 35-44). (WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007). Association for Computing Machinery, Inc. https://doi.org/10.1145/1273360.1273368

Podhorszki, Norbert ; Ludäscher, Bertram ; Klasky, Scott A. / Workflow automation for processing Plasma fusion Simulation data. WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007. Association for Computing Machinery, Inc, 2007. pp. 35-44 (WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007).

@inproceedings{2a649d998db3464cb5ba992a89d4342e,

title = "Workflow automation for processing Plasma fusion Simulation data",

abstract = "The Center for Plasma Edge Simulation project aims to automate simulation monitoring, data processing, and result archival using scientific workflows. We describe these tasks and requirements, and the newly developed Kepler workflow components that provide the required functionality for our automated workflow solution. Besides functionality, the focus is on the robust execution of the workflow. To this end, a user-level checkpointing model has been developed that allows a workflow to restart and re-execute operations that failed during a previous run.",

keywords = "Checkpointing, Kepler, Plasma fusion, SSH, Scientific workflow",

author = "Norbert Podhorszki and Bertram Lud{\"a}scher and Klasky, {Scott A.}",

year = "2007",

month = jun,

day = "25",

doi = "10.1145/1273360.1273368",

language = "English",

series = "WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007",

publisher = "Association for Computing Machinery, Inc",

pages = "35--44",

booktitle = "WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007",

}

Podhorszki, N, Ludäscher, B & Klasky, SA 2007, Workflow automation for processing Plasma fusion Simulation data. in WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007. WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007, Association for Computing Machinery, Inc, pp. 35-44, 2nd Workshop on Workflows in Support of Large-Scale Science, WORKS 2007, Monterey, United States, 06/25/07. https://doi.org/10.1145/1273360.1273368

Workflow automation for processing Plasma fusion Simulation data. / Podhorszki, Norbert; Ludäscher, Bertram; Klasky, Scott A.
WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007. Association for Computing Machinery, Inc, 2007. p. 35-44 (WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Workflow automation for processing Plasma fusion Simulation data

AU - Podhorszki, Norbert

AU - Ludäscher, Bertram

AU - Klasky, Scott A.

PY - 2007/6/25

Y1 - 2007/6/25

N2 - The Center for Plasma Edge Simulation project aims to automate simulation monitoring, data processing, and result archival using scientific workflows. We describe these tasks and requirements, and the newly developed Kepler workflow components that provide the required functionality for our automated workflow solution. Besides functionality, the focus is on the robust execution of the workflow. To this end, a user-level checkpointing model has been developed that allows a workflow to restart and re-execute operations that failed during a previous run.

AB - The Center for Plasma Edge Simulation project aims to automate simulation monitoring, data processing, and result archival using scientific workflows. We describe these tasks and requirements, and the newly developed Kepler workflow components that provide the required functionality for our automated workflow solution. Besides functionality, the focus is on the robust execution of the workflow. To this end, a user-level checkpointing model has been developed that allows a workflow to restart and re-execute operations that failed during a previous run.

KW - Checkpointing

KW - Kepler

KW - Plasma fusion

KW - SSH

KW - Scientific workflow

UR - http://www.scopus.com/inward/record.url?scp=85027517128&partnerID=8YFLogxK

U2 - 10.1145/1273360.1273368

DO - 10.1145/1273360.1273368

M3 - Conference contribution

AN - SCOPUS:85027517128

T3 - WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007

SP - 35

EP - 44

BT - WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007

PB - Association for Computing Machinery, Inc

T2 - 2nd Workshop on Workflows in Support of Large-Scale Science, WORKS 2007

Y2 - 25 June 2007

ER -

Podhorszki N, Ludäscher B, Klasky SA. Workflow automation for processing Plasma fusion Simulation data. In WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007. Association for Computing Machinery, Inc. 2007. p. 35-44. (WORKS 2007 - Proceedings of the 2nd Workshop on Workflows in Support of Large-Scale Science - 16th International Symposium on High Performance Distributed Computing, HPDC 2007). doi: 10.1145/1273360.1273368

Workflow automation for processing Plasma fusion Simulation data

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this