Automating environmental computing applications with scientific workflows

Rafael Ferreira Da Silva; Ewa Deelman; Rosa Filgueira; Karan Vahi; Mats Rynge; Rajiv Mayani; Benjamin Mayer

doi:10.1109/eScience.2016.7870926

Automating environmental computing applications with scientific workflows

Rafael Ferreira Da Silva, Ewa Deelman, Rosa Filgueira, Karan Vahi, Mats Rynge, Rajiv Mayani, Benjamin Mayer

Workflow and Ecosystem Services

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

13 Scopus citations

Abstract

Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

Original language	English
Title of host publication	Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	400-406
Number of pages	7
ISBN (Electronic)	9781509042722
DOIs	https://doi.org/10.1109/eScience.2016.7870926
State	Published - Mar 3 2017
Event	12th IEEE International Conference on e-Science, e-Science 2016 - Baltimore, United States Duration: Oct 23 2016 → Oct 27 2016

Publication series

Name	Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016

Conference

Conference	12th IEEE International Conference on e-Science, e-Science 2016
Country/Territory	United States
City	Baltimore
Period	10/23/16 → 10/27/16

Funding

This work was funded by DOE under the contract number #DESC0012636, "Panorama-Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows"; and by the National Science Foundation under the SI2-SSI program, award number 1148515.

Keywords

Environmental Computing
Pegasus Workflow Management System
Scientific workflows

Access to Document

10.1109/eScience.2016.7870926

Cite this

Da Silva, R. F., Deelman, E., Filgueira, R., Vahi, K., Rynge, M., Mayani, R., & Mayer, B. (2017). Automating environmental computing applications with scientific workflows. In Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016 (pp. 400-406). Article 7870926 (Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/eScience.2016.7870926

Da Silva, Rafael Ferreira ; Deelman, Ewa ; Filgueira, Rosa et al. / Automating environmental computing applications with scientific workflows. Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 400-406 (Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016).

@inproceedings{4dab2bd8ea744d3f81921978aaed1269,

title = "Automating environmental computing applications with scientific workflows",

abstract = "Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.",

keywords = "Environmental Computing, Pegasus Workflow Management System, Scientific workflows",

author = "{Da Silva}, {Rafael Ferreira} and Ewa Deelman and Rosa Filgueira and Karan Vahi and Mats Rynge and Rajiv Mayani and Benjamin Mayer",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 12th IEEE International Conference on e-Science, e-Science 2016 ; Conference date: 23-10-2016 Through 27-10-2016",

year = "2017",

month = mar,

day = "3",

doi = "10.1109/eScience.2016.7870926",

language = "English",

series = "Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "400--406",

booktitle = "Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016",

}

Da Silva, RF, Deelman, E, Filgueira, R, Vahi, K, Rynge, M, Mayani, R & Mayer, B 2017, Automating environmental computing applications with scientific workflows. in Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016., 7870926, Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016, Institute of Electrical and Electronics Engineers Inc., pp. 400-406, 12th IEEE International Conference on e-Science, e-Science 2016, Baltimore, United States, 10/23/16. https://doi.org/10.1109/eScience.2016.7870926

Automating environmental computing applications with scientific workflows. / Da Silva, Rafael Ferreira; Deelman, Ewa; Filgueira, Rosa et al.
Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 400-406 7870926 (Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Automating environmental computing applications with scientific workflows

AU - Da Silva, Rafael Ferreira

AU - Deelman, Ewa

AU - Filgueira, Rosa

AU - Vahi, Karan

AU - Rynge, Mats

AU - Mayani, Rajiv

AU - Mayer, Benjamin

PY - 2017/3/3

Y1 - 2017/3/3

N2 - Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

AB - Computational environmental science applications have evolved and become more complex over the last decade. In order to cope with the needs of such applications, computational methods and technologies have emerged to support the execution of these applications on heterogeneous, distributed systems. Among them are workflow management systems such as Pegasus. Pegasus is being used by researchers to model seismic wave propagation, to discover new celestial objects, to study RNA critical to human brain development, and to investigate other important research questions. This paper provides an introduction to scientific workflows and describes Pegasus and its main features. The paper highlights how the environmental science community has used Pegasus to automate their scientific workflow executions on high performance and high throughput computing systems by presenting three use cases: two Earth science workflows, and a climate science workflow.

KW - Environmental Computing

KW - Pegasus Workflow Management System

KW - Scientific workflows

UR - http://www.scopus.com/inward/record.url?scp=85016771384&partnerID=8YFLogxK

U2 - 10.1109/eScience.2016.7870926

DO - 10.1109/eScience.2016.7870926

M3 - Conference contribution

AN - SCOPUS:85016771384

T3 - Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016

SP - 400

EP - 406

BT - Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 12th IEEE International Conference on e-Science, e-Science 2016

Y2 - 23 October 2016 through 27 October 2016

ER -

Da Silva RF, Deelman E, Filgueira R, Vahi K, Rynge M, Mayani R et al. Automating environmental computing applications with scientific workflows. In Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 400-406. 7870926. (Proceedings of the 2016 IEEE 12th International Conference on e-Science, e-Science 2016). doi: 10.1109/eScience.2016.7870926

Automating environmental computing applications with scientific workflows

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this