TY - GEN
T1 - Benchmarking the Performance of Scientific Applications with Irregular I/O at the Extreme Scale
AU - Herbein, Stephen
AU - Klasky, Scott
AU - Taufer, Michela
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2015/5/7
Y1 - 2015/5/7
N2 - In this paper we hypothesize that irregularities of I/O patterns (i.e., irregular amount of data written per process at each I/O step) in scientific simulations can cause increasing I/O times and substantial loss in scalability. To study whether our hypothesis is true, we quantify the impact of irregular I/O patterns on the I/O performance of scientific applications at the extreme scale. Specifically, we statistically model the irregular I/O behavior of two scientific applications such as the Monte Carlo application QMCPack and the adaptive mesh refinement application ENZO. For our testing, we feed our model into an I/O skeleton tool to measure the performance of the two applications' I/O under different I/O settings. Empirically, we show how the growing data sizes and the irregular I/O patterns in these applications are both relevant factors impacting performance.
AB - In this paper we hypothesize that irregularities of I/O patterns (i.e., irregular amount of data written per process at each I/O step) in scientific simulations can cause increasing I/O times and substantial loss in scalability. To study whether our hypothesis is true, we quantify the impact of irregular I/O patterns on the I/O performance of scientific applications at the extreme scale. Specifically, we statistically model the irregular I/O behavior of two scientific applications such as the Monte Carlo application QMCPack and the adaptive mesh refinement application ENZO. For our testing, we feed our model into an I/O skeleton tool to measure the performance of the two applications' I/O under different I/O settings. Empirically, we show how the growing data sizes and the irregular I/O patterns in these applications are both relevant factors impacting performance.
KW - ADIOS I/O library
KW - HDF5
KW - I/O performance
UR - http://www.scopus.com/inward/record.url?scp=84946543421&partnerID=8YFLogxK
U2 - 10.1109/ICPPW.2014.46
DO - 10.1109/ICPPW.2014.46
M3 - Conference contribution
AN - SCOPUS:84946543421
T3 - Proceedings of the International Conference on Parallel Processing Workshops
SP - 292
EP - 301
BT - Proceedings - 43rd International Conference on Parallel Processing Workshops, ICPPW 2014
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 43rd International Conference on Parallel Processing Workshops, ICPPW 2014
Y2 - 9 September 2014 through 12 September 2014
ER -