PANORAMA: An approach to performance modeling and diagnosis of extreme-scale workflows

Ewa Deelman, Christopher Carothers, Anirban Mandal, Brian Tierney, Jeffrey S. Vetter, Ilya Baldin, Claris Castillo, Gideon Juve, Dariusz Król, Vickie Lynch, Ben Mayer, Jeremy Meredith, Thomas Proffen, Paul Ruth, Rafael Ferreira da Silva

Research output: Contribution to journalArticlepeer-review

26 Scopus citations

Abstract

Computational science is well established as the third pillar of scientific discovery and is on par with experimentation and theory. However, as we move closer toward the ability to execute exascale calculations and process the ensuing extreme-scale amounts of data produced by both experiments and computations alike, the complexity of managing the compute and data analysis tasks has grown beyond the capabilities of domain scientists. Thus, workflow management systems are absolutely necessary to ensure current and future scientific discoveries. A key research question for these workflow management systems concerns the performance optimization of complex calculation and data analysis tasks. The central contribution of this article is a description of the PANORAMA approach for modeling and diagnosing the run-time performance of complex scientific workflows. This approach integrates extreme-scale systems testbed experimentation, structured analytical modeling, and parallel systems simulation into a comprehensive workflow framework called Pegasus for understanding and improving the overall performance of complex scientific workflows.

Original languageEnglish
Pages (from-to)4-18
Number of pages15
JournalInternational Journal of High Performance Computing Applications
Volume31
Issue number1
DOIs
StatePublished - Jan 1 2017

Keywords

  • Performance modeling
  • extreme scale
  • scientific workflow

Fingerprint

Dive into the research topics of 'PANORAMA: An approach to performance modeling and diagnosis of extreme-scale workflows'. Together they form a unique fingerprint.

Cite this