TY - GEN
T1 - Towards FAIR Workflows for Federated Experimental Sciences
AU - Saranathan, Gayathri
AU - Martin, Foltin
AU - Tripathy, Aalap
AU - Justine, Annmary
AU - Ziatdinov, Maxim
AU - Ghosh, Ayana
AU - Roccapriore, Kevin
AU - Bhattacharya, Supama
AU - Faraboschi, Paolo
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.
AB - A de-centralized, peer-to-peer AI metadata framework is demonstrated which can enable end-to-end metadata & lineage tracking for distributed Machine Learning pipelines spanning edge, High Performance Computing, and cloud environments. With a specific example of end-to-end microscopy algorithm and datasets, the proposed method shows how to enable reproducibility, audit trail, provenance of metadata artifacts. The emerging needs of automation in experimental sciences, ML-centric workflows, and FAIR metadata management across federated compute environments is addressed.
KW - AI
KW - DKL
KW - FAIR
KW - HPC
KW - ML
UR - http://www.scopus.com/inward/record.url?scp=85201206055&partnerID=8YFLogxK
U2 - 10.1109/CAI59869.2024.00256
DO - 10.1109/CAI59869.2024.00256
M3 - Conference contribution
AN - SCOPUS:85201206055
T3 - Proceedings - 2024 IEEE Conference on Artificial Intelligence, CAI 2024
SP - 1436
EP - 1437
BT - Proceedings - 2024 IEEE Conference on Artificial Intelligence, CAI 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd IEEE Conference on Artificial Intelligence, CAI 2024
Y2 - 25 June 2024 through 27 June 2024
ER -