Workflow performance profiles: Development and analysis

Dariusz Król; Rafael Ferreira da Silva; Ewa Deelman; Vickie E. Lynch

doi:10.1007/978-3-319-58943-5_9

Workflow performance profiles: Development and analysis

Dariusz Król
, Rafael Ferreira da Silva
, Ewa Deelman
, Vickie E. Lynch

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

This paper presents a method for performance profiles development of scientific workflow. It addresses issues related to: workflows execution in a parameter sweep manner, collecting performance information about each workflow task, and analysis of the collected data with statistical learning methods. The main goal of this work is to increase the understanding about the performance of studied workflows in a systematic and predictable way. The evaluation of the presented approach is based on a real scientific workflow developed by the Spallation Neutron Source - a DOE research facility at the Oak Ridge National Laboratory. The workflow executes an ensemble of molecular dynamics and neutron scattering intensity calculations to optimize a model parameter value.

Original language	English
Title of host publication	Euro-Par 2016
Subtitle of host publication	Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers
Editors	Pierre-Francois Dutot, Frederic Desprez
Publisher	Springer Verlag
Pages	108-120
Number of pages	13
ISBN (Print)	9783319589428
DOIs	https://doi.org/10.1007/978-3-319-58943-5_9
State	Published - 2017
Externally published	Yes
Event	22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016 - Grenoble, France Duration: Aug 24 2016 → Aug 26 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10104 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016
Country/Territory	France
City	Grenoble
Period	08/24/16 → 08/26/16

Funding

This research was supported by DOE under contract #DE-SC0012636, “Panorama–Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows”. D. Król thanks to the EU FP7-ICT project PaaSage (317715) and Polish grant 3033/7PR/2014/2.

Access to Document

10.1007/978-3-319-58943-5_9

Cite this

Król, D., da Silva, R. F., Deelman, E., & Lynch, V. E. (2017). Workflow performance profiles: Development and analysis. In P.-F. Dutot, & F. Desprez (Eds.), Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers (pp. 108-120). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10104 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58943-5_9

Król, Dariusz ; da Silva, Rafael Ferreira ; Deelman, Ewa et al. / Workflow performance profiles : Development and analysis. Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. editor / Pierre-Francois Dutot ; Frederic Desprez. Springer Verlag, 2017. pp. 108-120 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d94fd3c245014cac8c7a6523d654f5ea,

title = "Workflow performance profiles: Development and analysis",

abstract = "This paper presents a method for performance profiles development of scientific workflow. It addresses issues related to: workflows execution in a parameter sweep manner, collecting performance information about each workflow task, and analysis of the collected data with statistical learning methods. The main goal of this work is to increase the understanding about the performance of studied workflows in a systematic and predictable way. The evaluation of the presented approach is based on a real scientific workflow developed by the Spallation Neutron Source - a DOE research facility at the Oak Ridge National Laboratory. The workflow executes an ensemble of molecular dynamics and neutron scattering intensity calculations to optimize a model parameter value.",

author = "Dariusz Kr{\'o}l and \{da Silva\}, \{Rafael Ferreira\} and Ewa Deelman and Lynch, \{Vickie E.\}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016 ; Conference date: 24-08-2016 Through 26-08-2016",

year = "2017",

doi = "10.1007/978-3-319-58943-5\_9",

language = "English",

isbn = "9783319589428",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "108--120",

editor = "Pierre-Francois Dutot and Frederic Desprez",

booktitle = "Euro-Par 2016",

}

Król, D, da Silva, RF, Deelman, E & Lynch, VE 2017, Workflow performance profiles: Development and analysis. in P-F Dutot & F Desprez (eds), Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10104 LNCS, Springer Verlag, pp. 108-120, 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016, Grenoble, France, 08/24/16. https://doi.org/10.1007/978-3-319-58943-5_9

Workflow performance profiles: Development and analysis. / Król, Dariusz; da Silva, Rafael Ferreira; Deelman, Ewa et al.
Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. ed. / Pierre-Francois Dutot; Frederic Desprez. Springer Verlag, 2017. p. 108-120 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10104 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Workflow performance profiles

T2 - 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016

AU - Król, Dariusz

AU - da Silva, Rafael Ferreira

AU - Deelman, Ewa

AU - Lynch, Vickie E.

PY - 2017

Y1 - 2017

N2 - This paper presents a method for performance profiles development of scientific workflow. It addresses issues related to: workflows execution in a parameter sweep manner, collecting performance information about each workflow task, and analysis of the collected data with statistical learning methods. The main goal of this work is to increase the understanding about the performance of studied workflows in a systematic and predictable way. The evaluation of the presented approach is based on a real scientific workflow developed by the Spallation Neutron Source - a DOE research facility at the Oak Ridge National Laboratory. The workflow executes an ensemble of molecular dynamics and neutron scattering intensity calculations to optimize a model parameter value.

AB - This paper presents a method for performance profiles development of scientific workflow. It addresses issues related to: workflows execution in a parameter sweep manner, collecting performance information about each workflow task, and analysis of the collected data with statistical learning methods. The main goal of this work is to increase the understanding about the performance of studied workflows in a systematic and predictable way. The evaluation of the presented approach is based on a real scientific workflow developed by the Spallation Neutron Source - a DOE research facility at the Oak Ridge National Laboratory. The workflow executes an ensemble of molecular dynamics and neutron scattering intensity calculations to optimize a model parameter value.

UR - https://www.scopus.com/pages/publications/85020415626

U2 - 10.1007/978-3-319-58943-5_9

DO - 10.1007/978-3-319-58943-5_9

M3 - Conference contribution

AN - SCOPUS:85020415626

SN - 9783319589428

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 108

EP - 120

BT - Euro-Par 2016

A2 - Dutot, Pierre-Francois

A2 - Desprez, Frederic

PB - Springer Verlag

Y2 - 24 August 2016 through 26 August 2016

ER -

Król D, da Silva RF, Deelman E, Lynch VE. Workflow performance profiles: Development and analysis. In Dutot PF, Desprez F, editors, Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. Springer Verlag. 2017. p. 108-120. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-58943-5_9

Workflow performance profiles: Development and analysis

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this