JOSHUA: Symmetric active/active replication for highly available HPC job and resource management

K. Uhlemann, C. Engelmann, S. L. Scott

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

15 Scopus citations

Abstract

Most of today's HPC systems employ a single head node for control, which represents a single point of failure as it interrupts an entire HPC system upon failure. Furthermore, it is also a single point of control as it disables an entire HPC system until repair. One of the most important HPC system service running on the head node is the job and resource management. If it goes down, all currently running jobs loose the service they report back to. They have to be restarted once the head node is up and running again. With this paper, we present a generic approach for providing symmetric active/active replication for highly available HPC job and resource management. The JOSHUA solution provides a virtually synchronous environment for continuous availability without any interruption of service and without any loss of state. Replication is performed externally via the PBS service interface without the need to modify any service code. Test results as well as availability analysis of our proof-of-concept prototype implementation show that continuous availability can be provided by JOSHUA with an acceptable performance trade-off.

Original languageEnglish
Title of host publication2006 IEEE International Conference on Cluster Computing, Cluster 2006
DOIs
StatePublished - 2006
Event2006 IEEE International Conference on Cluster Computing, Cluster 2006 - Barcelona, Spain
Duration: Sep 25 2006Sep 28 2006

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Conference

Conference2006 IEEE International Conference on Cluster Computing, Cluster 2006
Country/TerritorySpain
CityBarcelona
Period09/25/0609/28/06

Fingerprint

Dive into the research topics of 'JOSHUA: Symmetric active/active replication for highly available HPC job and resource management'. Together they form a unique fingerprint.

Cite this