System-level support for composition of applications

Brian Kocoloski; John Lange; Hasan Abbasi; David E. Bernholdt; Terry R. Jones; Jai Dayal; Noah Evans; Michael Lang; Jay Lofstead; Kevin Pedretti; Patrick G. Bridges

doi:10.1145/2768405.2768412

System-level support for composition of applications

Brian Kocoloski
, John Lange
, Hasan Abbasi
, David E. Bernholdt
, Terry R. Jones
, Jai Dayal
, Noah Evans
, Michael Lang
, Jay Lofstead
, Kevin Pedretti
, Patrick G. Bridges

Programming Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.

Original language	English
Title of host publication	Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015
Publisher	Association for Computing Machinery, Inc
ISBN (Electronic)	9781450336062
DOIs	https://doi.org/10.1145/2768405.2768412
State	Published - Jun 16 2015
Event	5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - Portland, United States Duration: Jun 16 2015 → …

Publication series

Name	Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015

Conference

Conference	5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015
Country/Territory	United States
City	Portland
Period	06/16/15 → …

Funding

This work has been supported by US Department of En-ergy, O_ce of Science, Advanced Scienti_c Computing Research program. This work was performed in part at Los Alamos National Laboratory, supported by the U.S. Department of Energy contract DE-FC02-06ER25750. This work was performed in part at the Oak Ridge National Laboratory, which is managed by UT-Battelle, LLC under contract DE-AC05-00OR22725. Sandia is a multiprogram laboratory oper-ated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy''s National Nuclear Security Administration under contract DE-AC04-94AL85000.

Access to Document

10.1145/2768405.2768412

Cite this

Kocoloski, B., Lange, J., Abbasi, H., Bernholdt, D. E., Jones, T. R., Dayal, J., Evans, N., Lang, M., Lofstead, J., Pedretti, K., & Bridges, P. G. (2015). System-level support for composition of applications. In Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015 Article a7 (Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015). Association for Computing Machinery, Inc. https://doi.org/10.1145/2768405.2768412

Kocoloski, Brian ; Lange, John ; Abbasi, Hasan et al. / System-level support for composition of applications. Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015. Association for Computing Machinery, Inc, 2015. (Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015).

@inproceedings{a9027b08b01d4255af14e165df6690c0,

title = "System-level support for composition of applications",

abstract = "Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.",

author = "Brian Kocoloski and John Lange and Hasan Abbasi and Bernholdt, \{David E.\} and Jones, \{Terry R.\} and Jai Dayal and Noah Evans and Michael Lang and Jay Lofstead and Kevin Pedretti and Bridges, \{Patrick G.\}",

note = "Publisher Copyright: {\textcopyright} 2015 Association for Computing Machinery.; 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 ; Conference date: 16-06-2015",

year = "2015",

month = jun,

day = "16",

doi = "10.1145/2768405.2768412",

language = "English",

series = "Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015",

publisher = "Association for Computing Machinery, Inc",

booktitle = "Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015",

}

Kocoloski, B, Lange, J, Abbasi, H, Bernholdt, DE , Jones, TR, Dayal, J, Evans, N, Lang, M, Lofstead, J, Pedretti, K & Bridges, PG 2015, System-level support for composition of applications. in Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015., a7, Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015, Association for Computing Machinery, Inc, 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015, Portland, United States, 06/16/15. https://doi.org/10.1145/2768405.2768412

System-level support for composition of applications. / Kocoloski, Brian; Lange, John; Abbasi, Hasan et al.
Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015. Association for Computing Machinery, Inc, 2015. a7 (Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - System-level support for composition of applications

AU - Kocoloski, Brian

AU - Lange, John

AU - Abbasi, Hasan

AU - Bernholdt, David E.

AU - Jones, Terry R.

AU - Dayal, Jai

AU - Evans, Noah

AU - Lang, Michael

AU - Lofstead, Jay

AU - Pedretti, Kevin

AU - Bridges, Patrick G.

PY - 2015/6/16

Y1 - 2015/6/16

N2 - Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.

AB - Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.

UR - https://www.scopus.com/pages/publications/84962082241

U2 - 10.1145/2768405.2768412

DO - 10.1145/2768405.2768412

M3 - Conference contribution

AN - SCOPUS:84962082241

T3 - Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015

BT - Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015

PB - Association for Computing Machinery, Inc

T2 - 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015

Y2 - 16 June 2015

ER -

Kocoloski B, Lange J, Abbasi H, Bernholdt DE , Jones TR, Dayal J et al. System-level support for composition of applications. In Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015. Association for Computing Machinery, Inc. 2015. a7. (Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2015 - In conjunction with HPDC 2015). doi: 10.1145/2768405.2768412

System-level support for composition of applications

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this