Reasons for a pessimistic or optimistic message logging protocol in MPI uncoordinated failure recovery

Aurelien Bouteiller, Thomas Ropars, George Bosilca, Christine Morin, Jack Dongarra

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Scopus citations

Abstract

With the growing scale of high performance computing platforms, fault tolerance has become a major issue. Among the various approaches for providing fault tolerance to MPI applications, message logging has been proved to tolerate higher failure rate. However, this advantage comes at the expense of a higher overhead on communications, due to latency intrusive logging of events to a stable storage. Previous work proposed and evaluated several protocols relaxing the synchronicity of event logging to moderate this overhead. Recently, the model of message logging has been refined to better match the reality of high performance network cards, where message receptions are decomposed in multiple interdependent events. According to this new model, deterministic and non-deterministic events are clearly discriminated, reducing the overhead induced by message logging. In this paper we compare, experimentally, a pessimistic and an optimistic message logging protocol, using this new model and implemented in the Open MPI library. Although pessimistic and optimistic message logging are, respectively, the most and less synchronous message logging paradigms, experiments show that most of the time their performance is comparable.

Original languageEnglish
Title of host publication2009 IEEE International Conference on Cluster Computing and Workshops, CLUSTER '09
DOIs
StatePublished - 2009
Externally publishedYes
Event2009 IEEE International Conference on Cluster Computing and Workshops, CLUSTER '09 - New Orleans, LA, United States
Duration: Aug 31 2009Sep 4 2009

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Conference

Conference2009 IEEE International Conference on Cluster Computing and Workshops, CLUSTER '09
Country/TerritoryUnited States
CityNew Orleans, LA
Period08/31/0909/4/09

Fingerprint

Dive into the research topics of 'Reasons for a pessimistic or optimistic message logging protocol in MPI uncoordinated failure recovery'. Together they form a unique fingerprint.

Cite this