Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols

Patrick M. Widener; Kurt B. Ferreira; Scott Levy

doi:10.1007/978-3-319-58943-5_50

Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols

Patrick M. Widener, Kurt B. Ferreira, Scott Levy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Fault-tolerance poses a major challenge for future large-scale systems. Active research into coordinated, uncoordinated, and hybrid checkpointing systems has explored how the introduction of asynchrony can address anticipated scalability issues. While fully uncoordinated approaches have been shown to have significant delays, the degree of sychronization required to keep overheads low has not yet been significantly addressed. In this paper, we use a simulation-based approach to show the impact of synchronization on local checkpoint activity. Specifically, we show the degree of synchronization needed to keep the impacts of local checkpointing low is attainable with current technology for a number of key production HPC workloads. Our work provides a critical analysis and comparison of synchronization and local checkpointing. This enables users and system administrators to fine-tune the checkpointing scheme to the application and system characteristics available.

Original language	English
Title of host publication	Euro-Par 2016
Subtitle of host publication	Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers
Editors	Pierre-Francois Dutot, Frederic Desprez
Publisher	Springer Verlag
Pages	623-634
Number of pages	12
ISBN (Print)	9783319589428
DOIs	https://doi.org/10.1007/978-3-319-58943-5_50
State	Published - 2017
Externally published	Yes
Event	22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016 - Grenoble, France Duration: Aug 24 2016 → Aug 26 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10104 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016
Country/Territory	France
City	Grenoble
Period	08/24/16 → 08/26/16

Funding

Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly-owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energy?s National Nuclear Security Administration under contract DE-AC04-94AL85000. SAND2016-5027C.

Funders	Funder number
U.S. Department of Energy?s National Nuclear Security Administration	SAND2016-5027C, DE-AC04-94AL85000
Lockheed Martin Corporation

Access to Document

10.1007/978-3-319-58943-5_50

Cite this

Widener, P. M., Ferreira, K. B., & Levy, S. (2017). Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols. In P.-F. Dutot, & F. Desprez (Eds.), Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers (pp. 623-634). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10104 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-58943-5_50

Widener, Patrick M. ; Ferreira, Kurt B. ; Levy, Scott. / Horseshoes and hand grenades : The case for approximate coordination in local checkpointing protocols. Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. editor / Pierre-Francois Dutot ; Frederic Desprez. Springer Verlag, 2017. pp. 623-634 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e128fb2e2a224e4b9ae9443ce109ca9a,

title = "Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols",

abstract = "Fault-tolerance poses a major challenge for future large-scale systems. Active research into coordinated, uncoordinated, and hybrid checkpointing systems has explored how the introduction of asynchrony can address anticipated scalability issues. While fully uncoordinated approaches have been shown to have significant delays, the degree of sychronization required to keep overheads low has not yet been significantly addressed. In this paper, we use a simulation-based approach to show the impact of synchronization on local checkpoint activity. Specifically, we show the degree of synchronization needed to keep the impacts of local checkpointing low is attainable with current technology for a number of key production HPC workloads. Our work provides a critical analysis and comparison of synchronization and local checkpointing. This enables users and system administrators to fine-tune the checkpointing scheme to the application and system characteristics available.",

author = "Widener, {Patrick M.} and Ferreira, {Kurt B.} and Scott Levy",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016 ; Conference date: 24-08-2016 Through 26-08-2016",

year = "2017",

doi = "10.1007/978-3-319-58943-5_50",

language = "English",

isbn = "9783319589428",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "623--634",

editor = "Pierre-Francois Dutot and Frederic Desprez",

booktitle = "Euro-Par 2016",

}

Widener, PM, Ferreira, KB & Levy, S 2017, Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols. in P-F Dutot & F Desprez (eds), Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10104 LNCS, Springer Verlag, pp. 623-634, 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016, Grenoble, France, 08/24/16. https://doi.org/10.1007/978-3-319-58943-5_50

Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols. / Widener, Patrick M.; Ferreira, Kurt B.; Levy, Scott.
Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. ed. / Pierre-Francois Dutot; Frederic Desprez. Springer Verlag, 2017. p. 623-634 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10104 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Horseshoes and hand grenades

T2 - 22nd International Conference on Parallel and Distributed Computing, Euro-Par 2016

AU - Widener, Patrick M.

AU - Ferreira, Kurt B.

AU - Levy, Scott

PY - 2017

Y1 - 2017

N2 - Fault-tolerance poses a major challenge for future large-scale systems. Active research into coordinated, uncoordinated, and hybrid checkpointing systems has explored how the introduction of asynchrony can address anticipated scalability issues. While fully uncoordinated approaches have been shown to have significant delays, the degree of sychronization required to keep overheads low has not yet been significantly addressed. In this paper, we use a simulation-based approach to show the impact of synchronization on local checkpoint activity. Specifically, we show the degree of synchronization needed to keep the impacts of local checkpointing low is attainable with current technology for a number of key production HPC workloads. Our work provides a critical analysis and comparison of synchronization and local checkpointing. This enables users and system administrators to fine-tune the checkpointing scheme to the application and system characteristics available.

AB - Fault-tolerance poses a major challenge for future large-scale systems. Active research into coordinated, uncoordinated, and hybrid checkpointing systems has explored how the introduction of asynchrony can address anticipated scalability issues. While fully uncoordinated approaches have been shown to have significant delays, the degree of sychronization required to keep overheads low has not yet been significantly addressed. In this paper, we use a simulation-based approach to show the impact of synchronization on local checkpoint activity. Specifically, we show the degree of synchronization needed to keep the impacts of local checkpointing low is attainable with current technology for a number of key production HPC workloads. Our work provides a critical analysis and comparison of synchronization and local checkpointing. This enables users and system administrators to fine-tune the checkpointing scheme to the application and system characteristics available.

UR - http://www.scopus.com/inward/record.url?scp=85020388280&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-58943-5_50

DO - 10.1007/978-3-319-58943-5_50

M3 - Conference contribution

AN - SCOPUS:85020388280

SN - 9783319589428

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 623

EP - 634

BT - Euro-Par 2016

A2 - Dutot, Pierre-Francois

A2 - Desprez, Frederic

PB - Springer Verlag

Y2 - 24 August 2016 through 26 August 2016

ER -

Widener PM, Ferreira KB, Levy S. Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols. In Dutot PF, Desprez F, editors, Euro-Par 2016: Parallel Processing Workshops - Euro-Par 2016 International Workshops, Revised Selected Papers. Springer Verlag. 2017. p. 623-634. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-58943-5_50

Horseshoes and hand grenades: The case for approximate coordination in local checkpointing protocols

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this