Dodging the cost of unavoidable memory copies in message logging protocols

George Bosilca; Aurelien Bouteiller; Thomas Herault; Pierre Lemarinier; Jack J. Dongarra

doi:10.1007/978-3-642-15646-5_20

Dodging the cost of unavoidable memory copies in message logging protocols

George Bosilca, Aurelien Bouteiller, Thomas Herault, Pierre Lemarinier, Jack J. Dongarra

Computer Science and Mathematics Div

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Scopus citations

Abstract

With the number of computing elements spiraling to hundred of thousands in modern HPC systems, failures are common events. Few applications are nevertheless fault tolerant; most are in need for a seamless recovery framework. Among the automatic fault tolerant techniques proposed for MPI, message logging is preferable for its scalable recovery. The major challenge for message logging protocols is the performance penalty on communications during failure-free periods, mostly coming from the payload copy introduced for each message. In this paper, we investigate different approaches for logging payload and compare their impact on network performance.

Original language	English
Title of host publication	Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings
Pages	189-197
Number of pages	9
DOIs	https://doi.org/10.1007/978-3-642-15646-5_20
State	Published - 2010
Event	17th European MPI Users' Group Meeting, EuroMPI 2010 - Stuttgart, Germany Duration: Sep 12 2010 → Sep 15 2010

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	6305 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th European MPI Users' Group Meeting, EuroMPI 2010
Country/Territory	Germany
City	Stuttgart
Period	09/12/10 → 09/15/10

Access to Document

10.1007/978-3-642-15646-5_20

Cite this

Bosilca, G., Bouteiller, A., Herault, T., Lemarinier, P., & Dongarra, J. J. (2010). Dodging the cost of unavoidable memory copies in message logging protocols. In Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings (pp. 189-197). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6305 LNCS). https://doi.org/10.1007/978-3-642-15646-5_20

Bosilca, George ; Bouteiller, Aurelien ; Herault, Thomas et al. / Dodging the cost of unavoidable memory copies in message logging protocols. Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings. 2010. pp. 189-197 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{3bcf470eeb6641b396311366183628db,

title = "Dodging the cost of unavoidable memory copies in message logging protocols",

abstract = "With the number of computing elements spiraling to hundred of thousands in modern HPC systems, failures are common events. Few applications are nevertheless fault tolerant; most are in need for a seamless recovery framework. Among the automatic fault tolerant techniques proposed for MPI, message logging is preferable for its scalable recovery. The major challenge for message logging protocols is the performance penalty on communications during failure-free periods, mostly coming from the payload copy introduced for each message. In this paper, we investigate different approaches for logging payload and compare their impact on network performance.",

author = "George Bosilca and Aurelien Bouteiller and Thomas Herault and Pierre Lemarinier and Dongarra, {Jack J.}",

year = "2010",

doi = "10.1007/978-3-642-15646-5_20",

language = "English",

isbn = "3642156452",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "189--197",

booktitle = "Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings",

note = "17th European MPI Users' Group Meeting, EuroMPI 2010 ; Conference date: 12-09-2010 Through 15-09-2010",

}

Bosilca, G, Bouteiller, A, Herault, T, Lemarinier, P & Dongarra, JJ 2010, Dodging the cost of unavoidable memory copies in message logging protocols. in Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6305 LNCS, pp. 189-197, 17th European MPI Users' Group Meeting, EuroMPI 2010, Stuttgart, Germany, 09/12/10. https://doi.org/10.1007/978-3-642-15646-5_20

Dodging the cost of unavoidable memory copies in message logging protocols. / Bosilca, George; Bouteiller, Aurelien; Herault, Thomas et al.
Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings. 2010. p. 189-197 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6305 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Dodging the cost of unavoidable memory copies in message logging protocols

AU - Bosilca, George

AU - Bouteiller, Aurelien

AU - Herault, Thomas

AU - Lemarinier, Pierre

AU - Dongarra, Jack J.

PY - 2010

Y1 - 2010

N2 - With the number of computing elements spiraling to hundred of thousands in modern HPC systems, failures are common events. Few applications are nevertheless fault tolerant; most are in need for a seamless recovery framework. Among the automatic fault tolerant techniques proposed for MPI, message logging is preferable for its scalable recovery. The major challenge for message logging protocols is the performance penalty on communications during failure-free periods, mostly coming from the payload copy introduced for each message. In this paper, we investigate different approaches for logging payload and compare their impact on network performance.

AB - With the number of computing elements spiraling to hundred of thousands in modern HPC systems, failures are common events. Few applications are nevertheless fault tolerant; most are in need for a seamless recovery framework. Among the automatic fault tolerant techniques proposed for MPI, message logging is preferable for its scalable recovery. The major challenge for message logging protocols is the performance penalty on communications during failure-free periods, mostly coming from the payload copy introduced for each message. In this paper, we investigate different approaches for logging payload and compare their impact on network performance.

UR - http://www.scopus.com/inward/record.url?scp=78149231438&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-15646-5_20

DO - 10.1007/978-3-642-15646-5_20

M3 - Conference contribution

AN - SCOPUS:78149231438

SN - 3642156452

SN - 9783642156458

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 189

EP - 197

BT - Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings

T2 - 17th European MPI Users' Group Meeting, EuroMPI 2010

Y2 - 12 September 2010 through 15 September 2010

ER -

Bosilca G, Bouteiller A, Herault T, Lemarinier P, Dongarra JJ. Dodging the cost of unavoidable memory copies in message logging protocols. In Recent Advances in the Message Passing Interface - 17th European MPI Users' Group Meeting, EuroMPI 2010, Proceedings. 2010. p. 189-197. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-15646-5_20

Dodging the cost of unavoidable memory copies in message logging protocols

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this