From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments

Anjus George; Meng Wang; Jesse Hanley; Garrett Wilson Ransom; John Bent; Christopher Zimmer

doi:10.1109/SCW63240.2024.00070

From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments

Anjus George, Meng Wang, Jesse Hanley, Garrett Wilson Ransom, John Bent, Christopher Zimmer

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Disk failure data provides valuable insights for preventing failures, enhancing storage robustness, guiding system design and deployment, and ensuring reliable operations at data centers. This paper introduces two disk failure datasets collected from large-scale HPC production environments over the past five years, comprising over 5,000 failure records from more than 40,000 disks. We analyzed these datasets across multiple dimensions, including temporal, spatial, and relational trends, and performed a comprehensive reliability assessment. Our analysis yielded numerous observations and insights that influence various operational aspects of HPC storage systems. We believe this study offers a holistic understanding of disk failure trends likely to interest the HPC storage community.

Original language	English
Title of host publication	Proceedings of SC 2024-W
Subtitle of host publication	Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	484-495
Number of pages	12
ISBN (Electronic)	9798350355543
DOIs	https://doi.org/10.1109/SCW63240.2024.00070
State	Published - 2024
Event	2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024 - Atlanta, United States Duration: Nov 17 2024 → Nov 22 2024

Publication series

Name	Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference	2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024
Country/Territory	United States
City	Atlanta
Period	11/17/24 → 11/22/24

Funding

This research was sponsored by and used resources of the Oak Ridge Leadership Computing Facility (OLCF), which is a DOE Office of Science User Facility at the Oak Ridge National Laboratory supported by the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

Keywords

Cause effect analysis
Failure data analysis
HPC storage
Hard disk drives
Reliability
Summit
Supercomputer

Access to Document

10.1109/SCW63240.2024.00070

Cite this

George, A., Wang, M., Hanley, J., Ransom, G. W., Bent, J., & Zimmer, C. (2024). From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments. In Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 484-495). (Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SCW63240.2024.00070

George, Anjus ; Wang, Meng ; Hanley, Jesse et al. / From Failure to Insight : Analyzing Disk Breakdowns in Large-Scale HPC Environments. Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2024. pp. 484-495 (Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis).

@inproceedings{15e4bddc84864334af5a2982e9e1a509,

title = "From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments",

abstract = "Disk failure data provides valuable insights for preventing failures, enhancing storage robustness, guiding system design and deployment, and ensuring reliable operations at data centers. This paper introduces two disk failure datasets collected from large-scale HPC production environments over the past five years, comprising over 5,000 failure records from more than 40,000 disks. We analyzed these datasets across multiple dimensions, including temporal, spatial, and relational trends, and performed a comprehensive reliability assessment. Our analysis yielded numerous observations and insights that influence various operational aspects of HPC storage systems. We believe this study offers a holistic understanding of disk failure trends likely to interest the HPC storage community.",

keywords = "Cause effect analysis, Failure data analysis, HPC storage, Hard disk drives, Reliability, Summit, Supercomputer",

author = "Anjus George and Meng Wang and Jesse Hanley and Ransom, {Garrett Wilson} and John Bent and Christopher Zimmer",

note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024 ; Conference date: 17-11-2024 Through 22-11-2024",

year = "2024",

doi = "10.1109/SCW63240.2024.00070",

language = "English",

series = "Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "484--495",

booktitle = "Proceedings of SC 2024-W",

}

George, A, Wang, M, Hanley, J, Ransom, GW, Bent, J & Zimmer, C 2024, From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments. in Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis. Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, Institute of Electrical and Electronics Engineers Inc., pp. 484-495, 2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024, Atlanta, United States, 11/17/24. https://doi.org/10.1109/SCW63240.2024.00070

From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments. / George, Anjus; Wang, Meng; Hanley, Jesse et al.
Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2024. p. 484-495 (Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - From Failure to Insight

T2 - 2024 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC Workshops 2024

AU - George, Anjus

AU - Wang, Meng

AU - Hanley, Jesse

AU - Ransom, Garrett Wilson

AU - Bent, John

AU - Zimmer, Christopher

PY - 2024

Y1 - 2024

N2 - Disk failure data provides valuable insights for preventing failures, enhancing storage robustness, guiding system design and deployment, and ensuring reliable operations at data centers. This paper introduces two disk failure datasets collected from large-scale HPC production environments over the past five years, comprising over 5,000 failure records from more than 40,000 disks. We analyzed these datasets across multiple dimensions, including temporal, spatial, and relational trends, and performed a comprehensive reliability assessment. Our analysis yielded numerous observations and insights that influence various operational aspects of HPC storage systems. We believe this study offers a holistic understanding of disk failure trends likely to interest the HPC storage community.

AB - Disk failure data provides valuable insights for preventing failures, enhancing storage robustness, guiding system design and deployment, and ensuring reliable operations at data centers. This paper introduces two disk failure datasets collected from large-scale HPC production environments over the past five years, comprising over 5,000 failure records from more than 40,000 disks. We analyzed these datasets across multiple dimensions, including temporal, spatial, and relational trends, and performed a comprehensive reliability assessment. Our analysis yielded numerous observations and insights that influence various operational aspects of HPC storage systems. We believe this study offers a holistic understanding of disk failure trends likely to interest the HPC storage community.

KW - Cause effect analysis

KW - Failure data analysis

KW - HPC storage

KW - Hard disk drives

KW - Reliability

KW - Summit

KW - Supercomputer

UR - http://www.scopus.com/inward/record.url?scp=85217185734&partnerID=8YFLogxK

U2 - 10.1109/SCW63240.2024.00070

DO - 10.1109/SCW63240.2024.00070

M3 - Conference contribution

AN - SCOPUS:85217185734

T3 - Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis

SP - 484

EP - 495

BT - Proceedings of SC 2024-W

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 17 November 2024 through 22 November 2024

ER -

George A, Wang M, Hanley J, Ransom GW, Bent J, Zimmer C. From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments. In Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc. 2024. p. 484-495. (Proceedings of SC 2024-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis). doi: 10.1109/SCW63240.2024.00070

From Failure to Insight: Analyzing Disk Breakdowns in Large-Scale HPC Environments

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this