UNITY: Unified memory and file space

Terry Jones; Michael J. Brim; Geoffroy Vallee; Benjamin Mayer; Aaron Welch; Tonglin Li; Michael Lang; Latchesar Ionkov; Douglas Otstott; Ada Gavrilovska; Greg Eisenhauer; Thaleia Doudali; Pradeep Fernando

doi:10.1145/3095770.3095776

UNITY: Unified memory and file space

Terry Jones, Michael J. Brim, Geoffroy Vallee, Benjamin Mayer, Aaron Welch, Tonglin Li, Michael Lang, Latchesar Ionkov, Douglas Otstott, Ada Gavrilovska, Greg Eisenhauer, Thaleia Doudali, Pradeep Fernando

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memoryand file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.

Original language	English
Title of host publication	Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC
Publisher	Association for Computing Machinery, Inc
ISBN (Electronic)	9781450350860
DOIs	https://doi.org/10.1145/3095770.3095776
State	Published - Jun 27 2017
Event	7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - Washington, United States Duration: Jun 27 2017 → …

Publication series

Name	Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC

Conference

Conference	7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017
Country/Territory	United States
City	Washington
Period	06/27/17 → …

Keywords

Automated data management
Memory hierarchy
Runtime systems

Access to Document

10.1145/3095770.3095776

Cite this

Jones, T., Brim, M. J., Vallee, G., Mayer, B., Welch, A., Li, T., Lang, M., Ionkov, L., Otstott, D., Gavrilovska, A., Eisenhauer, G., Doudali, T., & Fernando, P. (2017). UNITY: Unified memory and file space. In Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC Article a6 (Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC). Association for Computing Machinery, Inc. https://doi.org/10.1145/3095770.3095776

Jones, Terry ; Brim, Michael J. ; Vallee, Geoffroy et al. / UNITY : Unified memory and file space. Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC. Association for Computing Machinery, Inc, 2017. (Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC).

@inproceedings{54fb423fcab94b7bab7eaf0a6ef4234e,

title = "UNITY: Unified memory and file space",

abstract = "This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memoryand file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.",

keywords = "Automated data management, Memory hierarchy, Runtime systems",

author = "Terry Jones and Brim, {Michael J.} and Geoffroy Vallee and Benjamin Mayer and Aaron Welch and Tonglin Li and Michael Lang and Latchesar Ionkov and Douglas Otstott and Ada Gavrilovska and Greg Eisenhauer and Thaleia Doudali and Pradeep Fernando",

note = "Publisher Copyright: {\textcopyright} 2017 Copyright held by the owner/author(s).; 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 ; Conference date: 27-06-2017",

year = "2017",

month = jun,

day = "27",

doi = "10.1145/3095770.3095776",

language = "English",

series = "Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC",

publisher = "Association for Computing Machinery, Inc",

booktitle = "Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC",

}

Jones, T , Brim, MJ, Vallee, G, Mayer, B, Welch, A, Li, T, Lang, M, Ionkov, L, Otstott, D, Gavrilovska, A, Eisenhauer, G, Doudali, T & Fernando, P 2017, UNITY: Unified memory and file space. in Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC., a6, Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC, Association for Computing Machinery, Inc, 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017, Washington, United States, 06/27/17. https://doi.org/10.1145/3095770.3095776

UNITY: Unified memory and file space. / Jones, Terry ; Brim, Michael J.; Vallee, Geoffroy et al.
Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC. Association for Computing Machinery, Inc, 2017. a6 (Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - UNITY

T2 - 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017

AU - Jones, Terry

AU - Brim, Michael J.

AU - Vallee, Geoffroy

AU - Mayer, Benjamin

AU - Welch, Aaron

AU - Li, Tonglin

AU - Lang, Michael

AU - Ionkov, Latchesar

AU - Otstott, Douglas

AU - Gavrilovska, Ada

AU - Eisenhauer, Greg

AU - Doudali, Thaleia

AU - Fernando, Pradeep

PY - 2017/6/27

Y1 - 2017/6/27

N2 - This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memoryand file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.

AB - This paper describes the vision for UNITY, a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memoryand file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.

KW - Automated data management

KW - Memory hierarchy

KW - Runtime systems

UR - http://www.scopus.com/inward/record.url?scp=85025693645&partnerID=8YFLogxK

U2 - 10.1145/3095770.3095776

DO - 10.1145/3095770.3095776

M3 - Conference contribution

AN - SCOPUS:85025693645

T3 - Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC

BT - Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC

PB - Association for Computing Machinery, Inc

Y2 - 27 June 2017

ER -

Jones T , Brim MJ, Vallee G, Mayer B, Welch A, Li T et al. UNITY: Unified memory and file space. In Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC. Association for Computing Machinery, Inc. 2017. a6. (Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2017 - In conjunction with HPDC). doi: 10.1145/3095770.3095776

UNITY: Unified memory and file space

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this