A model for optimizing file access patterns using spatio-temporal parallelism

Boonthanome Nouanesengsy, John Patchett, James Ahrens, Andrew Bauer, Aashish Chaudhary, Ross Miller, Berk Geveci, Galen M. Shipman, Dean N. Williams

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

For many years now, I/O read time has been recognized as the primary bottleneck for parallel visualization and analysis of large-scale data. In this paper, we introduce a model that can estimate the read time for a file stored in a parallel filesystem when given the file access pattern. Read times ultimately depend on how the file is stored and the access pattern used to read the file. The file access pattern will be dictated by the type of parallel decomposition used. We employ spatio-temporal parallelism, which combines both spatial and temporal parallelism, to provide greater flexibility to possible file access patterns. Using our model, we were able to configure the spatio-temporal parallelism to design optimized read access patterns that resulted in a speedup factor of approximately 400 over traditional file access patterns.

Original languageEnglish
Title of host publicationProc. of UltraVis 2013
Subtitle of host publication8th Int. Workshop on Ultrascale Visualization - Held in Conjunction with SC 2013: The Int. Conference for High Performance Computing, Networking, Storage and Analysis
DOIs
StatePublished - 2013
Event8th International Workshop on Ultrascale Visualization, UltraVis 2013 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2013 - Denver, CO, United States
Duration: Nov 17 2013Nov 17 2013

Publication series

NameProc. of UltraVis 2013: 8th Int. Workshop on Ultrascale Visualization - Held in Conjunction with SC 2013: The Int. Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference8th International Workshop on Ultrascale Visualization, UltraVis 2013 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2013
Country/TerritoryUnited States
CityDenver, CO
Period11/17/1311/17/13

Keywords

  • Data analysis
  • I/O
  • Modeling
  • Parallel techniques
  • Visualization

Fingerprint

Dive into the research topics of 'A model for optimizing file access patterns using spatio-temporal parallelism'. Together they form a unique fingerprint.

Cite this