A web service-enabled distributed workflow system for scientific data processing

Rajesh Kalyanam; Lan Zhao; Taezoon Park; Sebastien Goasguen

doi:10.1109/FTDCS.2007.9

A web service-enabled distributed workflow system for scientific data processing

Rajesh Kalyanam
, Lan Zhao
, Taezoon Park
, Sebastien Goasguen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

This paper presents the design and implementation of a distributed data-driven workflow system on top of the TeraGrid infrastructure. The workflow system is based on a data management architecture that provides easy access to scientific data collections via the TeraGrid network. The workflow system allows researchers to construct scientific workflows for data discovery, access, transformation, and analysis. The system leverages JOpera, an open-source workflow engine and visual composer, as well as a set of web service-based data and computation modules. To demonstrate its effectiveness, we create an end-to-end climate simulation data analysis workflow that connects the data management architecture to TeraGrid computation resources. We also develop a workflow monitoring service to keep track of distributed workflow execution.

Original language	English
Title of host publication	Proceedings - FTDCS 2007
Subtitle of host publication	11th IEEE International Workshop on Future Trends of Distributed Computing Systems
Pages	7-14
Number of pages	8
DOIs	https://doi.org/10.1109/FTDCS.2007.9
State	Published - 2007
Externally published	Yes
Event	FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems - Sedona, AZ, United States Duration: Mar 21 2007 → Mar 23 2007

Publication series

Name	Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems

Conference

Conference	FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems
Country/Territory	United States
City	Sedona, AZ
Period	03/21/07 → 03/23/07

Access to Document

10.1109/FTDCS.2007.9

Cite this

Kalyanam, R., Zhao, L., Park, T., & Goasguen, S. (2007). A web service-enabled distributed workflow system for scientific data processing. In Proceedings - FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems (pp. 7-14). Article 4144608 (Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems). https://doi.org/10.1109/FTDCS.2007.9

@inproceedings{3e343441fcf84e4490bb662e61652f48,

title = "A web service-enabled distributed workflow system for scientific data processing",

abstract = "This paper presents the design and implementation of a distributed data-driven workflow system on top of the TeraGrid infrastructure. The workflow system is based on a data management architecture that provides easy access to scientific data collections via the TeraGrid network. The workflow system allows researchers to construct scientific workflows for data discovery, access, transformation, and analysis. The system leverages JOpera, an open-source workflow engine and visual composer, as well as a set of web service-based data and computation modules. To demonstrate its effectiveness, we create an end-to-end climate simulation data analysis workflow that connects the data management architecture to TeraGrid computation resources. We also develop a workflow monitoring service to keep track of distributed workflow execution.",

author = "Rajesh Kalyanam and Lan Zhao and Taezoon Park and Sebastien Goasguen",

year = "2007",

doi = "10.1109/FTDCS.2007.9",

language = "English",

isbn = "0769528104",

series = "Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems",

pages = "7--14",

booktitle = "Proceedings - FTDCS 2007",

note = "FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems ; Conference date: 21-03-2007 Through 23-03-2007",

}

Kalyanam, R, Zhao, L, Park, T & Goasguen, S 2007, A web service-enabled distributed workflow system for scientific data processing. in Proceedings - FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems., 4144608, Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems, pp. 7-14, FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems, Sedona, AZ, United States, 03/21/07. https://doi.org/10.1109/FTDCS.2007.9

A web service-enabled distributed workflow system for scientific data processing. / Kalyanam, Rajesh; Zhao, Lan; Park, Taezoon et al.
Proceedings - FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems. 2007. p. 7-14 4144608 (Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A web service-enabled distributed workflow system for scientific data processing

AU - Kalyanam, Rajesh

AU - Zhao, Lan

AU - Park, Taezoon

AU - Goasguen, Sebastien

PY - 2007

Y1 - 2007

N2 - This paper presents the design and implementation of a distributed data-driven workflow system on top of the TeraGrid infrastructure. The workflow system is based on a data management architecture that provides easy access to scientific data collections via the TeraGrid network. The workflow system allows researchers to construct scientific workflows for data discovery, access, transformation, and analysis. The system leverages JOpera, an open-source workflow engine and visual composer, as well as a set of web service-based data and computation modules. To demonstrate its effectiveness, we create an end-to-end climate simulation data analysis workflow that connects the data management architecture to TeraGrid computation resources. We also develop a workflow monitoring service to keep track of distributed workflow execution.

AB - This paper presents the design and implementation of a distributed data-driven workflow system on top of the TeraGrid infrastructure. The workflow system is based on a data management architecture that provides easy access to scientific data collections via the TeraGrid network. The workflow system allows researchers to construct scientific workflows for data discovery, access, transformation, and analysis. The system leverages JOpera, an open-source workflow engine and visual composer, as well as a set of web service-based data and computation modules. To demonstrate its effectiveness, we create an end-to-end climate simulation data analysis workflow that connects the data management architecture to TeraGrid computation resources. We also develop a workflow monitoring service to keep track of distributed workflow execution.

UR - https://www.scopus.com/pages/publications/34547282747

U2 - 10.1109/FTDCS.2007.9

DO - 10.1109/FTDCS.2007.9

M3 - Conference contribution

AN - SCOPUS:34547282747

SN - 0769528104

SN - 9780769528106

T3 - Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems

SP - 7

EP - 14

BT - Proceedings - FTDCS 2007

T2 - FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems

Y2 - 21 March 2007 through 23 March 2007

ER -

Kalyanam R, Zhao L, Park T, Goasguen S. A web service-enabled distributed workflow system for scientific data processing. In Proceedings - FTDCS 2007: 11th IEEE International Workshop on Future Trends of Distributed Computing Systems. 2007. p. 7-14. 4144608. (Proceedings of the IEEE Computer Society Workshop on Future Trends of Distributed Computing Systems). doi: 10.1109/FTDCS.2007.9

A web service-enabled distributed workflow system for scientific data processing

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this