A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI

Joshua Hursey; Thomas Naughton; Geoffroy Vallee; Richard L. Graham

doi:10.1007/978-3-642-24449-0_29

A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI

Joshua Hursey, Thomas Naughton, Geoffroy Vallee, Richard L. Graham

Intelligent Systems and Facilities

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

17 Scopus citations

Abstract

The lack of fault tolerance is becoming a limiting factor for application scalability in HPC systems. The MPI does not provide standardized fault tolerance interfaces and semantics. The MPI Forum's Fault Tolerance Working Group is proposing a collective fault tolerant agreement algorithm for the next MPI standard. Such algorithms play a central role in many fault tolerant applications. This paper combines a log-scaling two-phase commit agreement algorithm with a reduction operation to provide the necessary functionality for the new collective without any additional messages. Error handling mechanisms are described that preserve the fault tolerance properties while maintaining overall scalability.

Original language	English
Title of host publication	Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings
Pages	255-263
Number of pages	9
DOIs	https://doi.org/10.1007/978-3-642-24449-0_29
State	Published - 2011
Event	18th European Message Passing Interface Users' Group Meeting, EuroMPI 2011 - Santorini, Greece Duration: Sep 18 2011 → Sep 21 2011

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	6960 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th European Message Passing Interface Users' Group Meeting, EuroMPI 2011
Country/Territory	Greece
City	Santorini
Period	09/18/11 → 09/21/11

Funding

Acknowledgments. Research sponsored by the Mathematical, Information, and Computational Sciences Division, Office of Advanced Scientific Computing Research, U.S. Department of Energy, under Contract No. DE-AC05-00OR22725 with UT-Battelle, LLC.

Funders	Funder number
U.S. Department of Energy
Advanced Scientific Computing Research

Keywords

Agreement Protocol
Algorithm Based Fault Tolerance
Fault Tolerance
MPI
Run-through Stabilization

Access to Document

10.1007/978-3-642-24449-0_29

Cite this

Hursey, J., Naughton, T., Vallee, G., & Graham, R. L. (2011). A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI. In Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings (pp. 255-263). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6960 LNCS). https://doi.org/10.1007/978-3-642-24449-0_29

Hursey, Joshua ; Naughton, Thomas ; Vallee, Geoffroy et al. / A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI. Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings. 2011. pp. 255-263 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d6fbe0c171af4e83b8f6056814c41d37,

title = "A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI",

abstract = "The lack of fault tolerance is becoming a limiting factor for application scalability in HPC systems. The MPI does not provide standardized fault tolerance interfaces and semantics. The MPI Forum's Fault Tolerance Working Group is proposing a collective fault tolerant agreement algorithm for the next MPI standard. Such algorithms play a central role in many fault tolerant applications. This paper combines a log-scaling two-phase commit agreement algorithm with a reduction operation to provide the necessary functionality for the new collective without any additional messages. Error handling mechanisms are described that preserve the fault tolerance properties while maintaining overall scalability.",

keywords = "Agreement Protocol, Algorithm Based Fault Tolerance, Fault Tolerance, MPI, Run-through Stabilization",

author = "Joshua Hursey and Thomas Naughton and Geoffroy Vallee and Graham, {Richard L.}",

year = "2011",

doi = "10.1007/978-3-642-24449-0_29",

language = "English",

isbn = "9783642244483",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "255--263",

booktitle = "Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings",

note = "18th European Message Passing Interface Users' Group Meeting, EuroMPI 2011 ; Conference date: 18-09-2011 Through 21-09-2011",

}

Hursey, J, Naughton, T, Vallee, G & Graham, RL 2011, A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI. in Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6960 LNCS, pp. 255-263, 18th European Message Passing Interface Users' Group Meeting, EuroMPI 2011, Santorini, Greece, 09/18/11. https://doi.org/10.1007/978-3-642-24449-0_29

A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI. / Hursey, Joshua; Naughton, Thomas; Vallee, Geoffroy et al.
Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings. 2011. p. 255-263 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6960 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI

AU - Hursey, Joshua

AU - Naughton, Thomas

AU - Vallee, Geoffroy

AU - Graham, Richard L.

PY - 2011

Y1 - 2011

N2 - The lack of fault tolerance is becoming a limiting factor for application scalability in HPC systems. The MPI does not provide standardized fault tolerance interfaces and semantics. The MPI Forum's Fault Tolerance Working Group is proposing a collective fault tolerant agreement algorithm for the next MPI standard. Such algorithms play a central role in many fault tolerant applications. This paper combines a log-scaling two-phase commit agreement algorithm with a reduction operation to provide the necessary functionality for the new collective without any additional messages. Error handling mechanisms are described that preserve the fault tolerance properties while maintaining overall scalability.

AB - The lack of fault tolerance is becoming a limiting factor for application scalability in HPC systems. The MPI does not provide standardized fault tolerance interfaces and semantics. The MPI Forum's Fault Tolerance Working Group is proposing a collective fault tolerant agreement algorithm for the next MPI standard. Such algorithms play a central role in many fault tolerant applications. This paper combines a log-scaling two-phase commit agreement algorithm with a reduction operation to provide the necessary functionality for the new collective without any additional messages. Error handling mechanisms are described that preserve the fault tolerance properties while maintaining overall scalability.

KW - Agreement Protocol

KW - Algorithm Based Fault Tolerance

KW - Fault Tolerance

KW - MPI

KW - Run-through Stabilization

UR - http://www.scopus.com/inward/record.url?scp=80052974659&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-24449-0_29

DO - 10.1007/978-3-642-24449-0_29

M3 - Conference contribution

AN - SCOPUS:80052974659

SN - 9783642244483

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 255

EP - 263

BT - Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings

T2 - 18th European Message Passing Interface Users' Group Meeting, EuroMPI 2011

Y2 - 18 September 2011 through 21 September 2011

ER -

Hursey J, Naughton T, Vallee G, Graham RL. A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI. In Recent Advances in the Message Passing Interface - 18th European MPI Users' Group Meeting, EuroMPI 2011, Proceedings. 2011. p. 255-263. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-24449-0_29

A log-scaling fault tolerant agreement algorithm for a fault tolerant MPI

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this