TY - GEN
T1 - DataFed
T2 - 6th Annual International Conference on Computational Science and Computational Intelligence, CSCI 2019
AU - Stansberry, Dale
AU - Somnath, Suhas
AU - Breet, Jessica
AU - Shutt, Gregory
AU - Shankar, Mallikarjun
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/12
Y1 - 2019/12
N2 - The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a logical and holistic view of data that greatly simplifies and empowers data organization, curation, searching, sharing, dissemination, etc. We present DataFed - a lightweight, distributed SDMS that spans a federation of storage systems within a loosely-coupled network of scientific facilities. Unlike existing SDMS offerings, DataFed uses high-performance and scalable user management and data transfer technologies that simplify deployment, maintenance, and expansion of DataFed. DataFed provides web-based and command-line interfaces to manage data and integrate with complex scientific workflows. DataFed represents a step towards reproducible scientific research by enabling reliable staging of the correct data at the desired environment.
AB - The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a logical and holistic view of data that greatly simplifies and empowers data organization, curation, searching, sharing, dissemination, etc. We present DataFed - a lightweight, distributed SDMS that spans a federation of storage systems within a loosely-coupled network of scientific facilities. Unlike existing SDMS offerings, DataFed uses high-performance and scalable user management and data transfer technologies that simplify deployment, maintenance, and expansion of DataFed. DataFed provides web-based and command-line interfaces to manage data and integrate with complex scientific workflows. DataFed represents a step towards reproducible scientific research by enabling reliable staging of the correct data at the desired environment.
KW - Cross-facility
KW - FAIR data principles
KW - Federated identity management
KW - Globus
KW - Scientific data management system
UR - http://www.scopus.com/inward/record.url?scp=85084728594&partnerID=8YFLogxK
U2 - 10.1109/CSCI49370.2019.00245
DO - 10.1109/CSCI49370.2019.00245
M3 - Conference contribution
AN - SCOPUS:85084728594
T3 - Proceedings - 6th Annual Conference on Computational Science and Computational Intelligence, CSCI 2019
SP - 1312
EP - 1317
BT - Proceedings - 6th Annual Conference on Computational Science and Computational Intelligence, CSCI 2019
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 5 December 2019 through 7 December 2019
ER -