Abstract
As the memory and storage hierarchy get deeper and more complex, it is important to have new benchmarks and evaluation tools that allow us to explore the emerging middleware solutions to use this hierarchy. Skel is a tool aimed at automating and refining this process of studying HPC I/O performance. It works by generating application I/O kernel/benchmarks as determined by a domain-specific model. This paper provides some techniques for extending Skel to address new situations and to answer new research questions. For example, we document use cases as diverse as using Skel to troubleshoot I/O performance issues for remote users, refining an I/O system model, and facilitating the development and testing of a mechanism for runtime monitoring and performance analytics. We also discuss data oriented extensions to Skel to support the study of compression techniques for Exascale scientific data management.
Original language | English |
---|---|
Title of host publication | Proceedings - 2017 IEEE International Conference on Cluster Computing, CLUSTER 2017 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 563-571 |
Number of pages | 9 |
ISBN (Electronic) | 9781538623268 |
DOIs | |
State | Published - Sep 22 2017 |
Event | 2017 IEEE International Conference on Cluster Computing, CLUSTER 2017 - Honolulu, United States Duration: Sep 5 2017 → Sep 8 2017 |
Publication series
Name | Proceedings - IEEE International Conference on Cluster Computing, ICCC |
---|---|
Volume | 2017-September |
ISSN (Print) | 1552-5244 |
Conference
Conference | 2017 IEEE International Conference on Cluster Computing, CLUSTER 2017 |
---|---|
Country/Territory | United States |
City | Honolulu |
Period | 09/5/17 → 09/8/17 |
Funding
Support was also provided by the National Science Foundation under Grant Number 1265403. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. This material is based upon work supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, Program Manager Dr. Lucy Nowell, under Award Number DE-SC0012537. Also, this research used resources of the Oak Ridge Leadership Computing Facility, which is a DOE Office of Science User Facility.
Keywords
- Adios
- Data Compression
- Generative Programming
- High Performance I/O
- I/O benchmarking
- I/O performance
- Mini Applications
- Runtime performance analytics
- Runtime performance monitoring
- Scientific Data Management
- Skel