FINAL: Flexible and scalable composition of file system name spaces

Michael J. Brim, Barton P. Miller, Vic Zandy

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Group file operations enable tools and middleware to operate upon a large group of files located across thousands of independent servers in a scalable fashion, a necessary requirement for effective use of today's largest distributed systems. Our initial prototype of group file operations showed scalability benefits for several tools, but also revealed the importance of having a scalable method for defining useful groups. We have developed a language called FINAL for describing name space composition in a flexible and scalable manner. Clients of our TBON-FS distributed file system can use this language to compose a single-system image (SSI) name space that automatically creates useful groups in a scalable fashion. We provide many examples of traditional and SSI name space compositions that can be described using FINAL, and report how TBON-FS can compose a global name space from tens of thousands of independent name spaces in one-quarter second.

Original languageEnglish
Title of host publicationProceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2011
Pages25-32
Number of pages8
DOIs
StatePublished - 2011
Externally publishedYes
Event1st International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2011 - Tucson, AZ, United States
Duration: May 31 2011May 31 2011

Publication series

NameProceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2011

Conference

Conference1st International Workshop on Runtime and Operating Systems for Supercomputers, ROSS 2011
Country/TerritoryUnited States
CityTucson, AZ
Period05/31/1105/31/11

Keywords

  • composition
  • file system
  • middleware
  • name space
  • scalability

Fingerprint

Dive into the research topics of 'FINAL: Flexible and scalable composition of file system name spaces'. Together they form a unique fingerprint.

Cite this