Fides: A General Purpose Data Model Library for Streaming Data

David Pugmire; Caitlin Ross; Nicholas Thompson; James Kress; Chuck Atkins; Scott Klasky; Berk Geveci

doi:10.1007/978-3-030-90539-2_34

Fides: A General Purpose Data Model Library for Streaming Data

David Pugmire, Caitlin Ross, Nicholas Thompson, James Kress, Chuck Atkins, Scott Klasky, Berk Geveci

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Scopus citations

Abstract

Data models are required to provide the semantics of the underlying data stream for in situ visualization. In this paper we describe a set of metrics for such a data model that are useful in meeting the needs of the scientific community for visualization. We then present Fides, a library that provides a schema for the VTK-m data model, and uses the ADIOS middleware library for access to streaming data. We present four use cases of Fides in different scientific workflows, and provide an evaluation of each use case against our metrics.

Original language	English
Title of host publication	High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers
Editors	Heike Jagode, Hartwig Anzt, Hatem Ltaief, Piotr Luszczek
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	495-507
Number of pages	13
ISBN (Print)	9783030905385
DOIs	https://doi.org/10.1007/978-3-030-90539-2_34
State	Published - 2021
Event	International Conference on High Performance Computing, ISC High Performance 2021 - Virtual, Online Duration: Jun 24 2021 → Jul 2 2021

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12761 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	International Conference on High Performance Computing, ISC High Performance 2021
City	Virtual, Online
Period	06/24/21 → 07/2/21

Funding

Acknowledgements. This work was supported by the U.S. Department of Energy, Office of Science, Office of Fusion Energy Sciences under Award Number DE-SC0018054 and the Scientific Discovery through Advanced Computing (SciDAC) program in U.S. Department of Energy. This work also used resources of the Oak Ridge Leadership Computing Facility, which is a U.S. Department of Energy, Office of Science User Facility.

Funders	Funder number
U.S. Department of Energy
Office of Science
Fusion Energy Sciences	DE-SC0018054

Access to Document

10.1007/978-3-030-90539-2_34

Cite this

Pugmire, D., Ross, C., Thompson, N., Kress, J., Atkins, C., Klasky, S., & Geveci, B. (2021). Fides: A General Purpose Data Model Library for Streaming Data. In H. Jagode, H. Anzt, H. Ltaief, & P. Luszczek (Eds.), High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers (pp. 495-507). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12761 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-90539-2_34

Pugmire, David ; Ross, Caitlin ; Thompson, Nicholas et al. / Fides : A General Purpose Data Model Library for Streaming Data. High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers. editor / Heike Jagode ; Hartwig Anzt ; Hatem Ltaief ; Piotr Luszczek. Springer Science and Business Media Deutschland GmbH, 2021. pp. 495-507 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{fcc33334bcb943588e772127a0470b11,

title = "Fides: A General Purpose Data Model Library for Streaming Data",

abstract = "Data models are required to provide the semantics of the underlying data stream for in situ visualization. In this paper we describe a set of metrics for such a data model that are useful in meeting the needs of the scientific community for visualization. We then present Fides, a library that provides a schema for the VTK-m data model, and uses the ADIOS middleware library for access to streaming data. We present four use cases of Fides in different scientific workflows, and provide an evaluation of each use case against our metrics.",

author = "David Pugmire and Caitlin Ross and Nicholas Thompson and James Kress and Chuck Atkins and Scott Klasky and Berk Geveci",

note = "Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; International Conference on High Performance Computing, ISC High Performance 2021 ; Conference date: 24-06-2021 Through 02-07-2021",

year = "2021",

doi = "10.1007/978-3-030-90539-2_34",

language = "English",

isbn = "9783030905385",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "495--507",

editor = "Heike Jagode and Hartwig Anzt and Hatem Ltaief and Piotr Luszczek",

booktitle = "High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers",

}

Pugmire, D, Ross, C, Thompson, N, Kress, J, Atkins, C, Klasky, S & Geveci, B 2021, Fides: A General Purpose Data Model Library for Streaming Data. in H Jagode, H Anzt, H Ltaief & P Luszczek (eds), High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12761 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 495-507, International Conference on High Performance Computing, ISC High Performance 2021, Virtual, Online, 06/24/21. https://doi.org/10.1007/978-3-030-90539-2_34

Fides: A General Purpose Data Model Library for Streaming Data. / Pugmire, David; Ross, Caitlin; Thompson, Nicholas et al.
High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers. ed. / Heike Jagode; Hartwig Anzt; Hatem Ltaief; Piotr Luszczek. Springer Science and Business Media Deutschland GmbH, 2021. p. 495-507 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12761 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Fides

T2 - International Conference on High Performance Computing, ISC High Performance 2021

AU - Pugmire, David

AU - Ross, Caitlin

AU - Thompson, Nicholas

AU - Kress, James

AU - Atkins, Chuck

AU - Klasky, Scott

AU - Geveci, Berk

PY - 2021

Y1 - 2021

N2 - Data models are required to provide the semantics of the underlying data stream for in situ visualization. In this paper we describe a set of metrics for such a data model that are useful in meeting the needs of the scientific community for visualization. We then present Fides, a library that provides a schema for the VTK-m data model, and uses the ADIOS middleware library for access to streaming data. We present four use cases of Fides in different scientific workflows, and provide an evaluation of each use case against our metrics.

AB - Data models are required to provide the semantics of the underlying data stream for in situ visualization. In this paper we describe a set of metrics for such a data model that are useful in meeting the needs of the scientific community for visualization. We then present Fides, a library that provides a schema for the VTK-m data model, and uses the ADIOS middleware library for access to streaming data. We present four use cases of Fides in different scientific workflows, and provide an evaluation of each use case against our metrics.

UR - http://www.scopus.com/inward/record.url?scp=85119837506&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-90539-2_34

DO - 10.1007/978-3-030-90539-2_34

M3 - Conference contribution

AN - SCOPUS:85119837506

SN - 9783030905385

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 495

EP - 507

BT - High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers

A2 - Jagode, Heike

A2 - Anzt, Hartwig

A2 - Ltaief, Hatem

A2 - Luszczek, Piotr

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 24 June 2021 through 2 July 2021

ER -

Pugmire D, Ross C, Thompson N, Kress J, Atkins C, Klasky S et al. Fides: A General Purpose Data Model Library for Streaming Data. In Jagode H, Anzt H, Ltaief H, Luszczek P, editors, High Performance Computing - ISC High Performance Digital 2021 International Workshops, 2021, Revised Selected Papers. Springer Science and Business Media Deutschland GmbH. 2021. p. 495-507. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-90539-2_34

Fides: A General Purpose Data Model Library for Streaming Data

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this