Data staging effects in wide area task farming applications

Wael R. Elwasif, James S. Plank, Rich Wolski

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

Recent advances in computing and communication have given rise to the computational grid notion (I. Foster and C. Kesselman, 1998). The core of this computing paradigm is the design of a system for drawing compute power from a confederation of geographically dispersed heterogeneous resources, seamlessly and ubiquitously. If high-performance levels are to be achieved, data locality must be identified and managed. We consider the effect of server side staging on the behavior of a class of wide area task farming or parameter sweep applications. We show that staging improves task throughput mainly through the increased parallelism rather than the reduction in overall turnaround time per task. We derive a model for farming applications with and without server side staging and verify the model through live experiments as well as simulations.

Original languageEnglish
Title of host publicationProceedings - 1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001
Pages122-129
Number of pages8
DOIs
StatePublished - 2001
Event1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001 - Brisbane, QLD, Australia
Duration: May 15 2001May 18 2001

Publication series

NameProceedings - 1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001

Conference

Conference1st IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGrid 2001
Country/TerritoryAustralia
CityBrisbane, QLD
Period05/15/0105/18/01

Fingerprint

Dive into the research topics of 'Data staging effects in wide area task farming applications'. Together they form a unique fingerprint.

Cite this