TY - GEN
T1 - Visualization as a service for scientific data
AU - Pugmire, David
AU - Kress, James
AU - Chen, Jieyang
AU - Childs, Hank
AU - Choi, Jong
AU - Ganyushin, Dmitry
AU - Geveci, Berk
AU - Kim, Mark
AU - Klasky, Scott
AU - Liang, Xin
AU - Logan, Jeremy
AU - Marsaglia, Nicole
AU - Mehta, Kshitij
AU - Podhorszki, Norbert
AU - Ross, Caitlin
AU - Suchyta, Eric
AU - Thompson, Nick
AU - Walton, Steven
AU - Wan, Lipeng
AU - Wolf, Matthew
N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2020.
PY - 2021
Y1 - 2021
N2 - One of the primary challenges facing scientists is extracting understanding from the large amounts of data produced by simulations, experiments, and observational facilities. The use of data across the entire lifetime ranging from real-time to post-hoc analysis is complex and varied, typically requiring a collaborative effort across multiple teams of scientists. Over time, three sets of tools have emerged: One set for analysis, another for visualization, and a final set for orchestrating the tasks. This trifurcated tool set often results in the manual assembly of analysis and visualization workflows, which are one-off solutions that are often fragile and difficult to generalize. To address these challenges, we propose a serviced-based paradigm and a set of abstractions to guide its design. These abstractions allow for the creation of services that can access and interpret data, and enable interoperability for intelligent scheduling of workflow systems. This work results from a codesign process over analysis, visualization, and workflow tools to provide the flexibility required for production use. Finally, this paper describes a forward-looking research and development plan that centers on the concept of visualization and analysis technology as reusable services, and also describes several realworld use cases that implement these concepts.
AB - One of the primary challenges facing scientists is extracting understanding from the large amounts of data produced by simulations, experiments, and observational facilities. The use of data across the entire lifetime ranging from real-time to post-hoc analysis is complex and varied, typically requiring a collaborative effort across multiple teams of scientists. Over time, three sets of tools have emerged: One set for analysis, another for visualization, and a final set for orchestrating the tasks. This trifurcated tool set often results in the manual assembly of analysis and visualization workflows, which are one-off solutions that are often fragile and difficult to generalize. To address these challenges, we propose a serviced-based paradigm and a set of abstractions to guide its design. These abstractions allow for the creation of services that can access and interpret data, and enable interoperability for intelligent scheduling of workflow systems. This work results from a codesign process over analysis, visualization, and workflow tools to provide the flexibility required for production use. Finally, this paper describes a forward-looking research and development plan that centers on the concept of visualization and analysis technology as reusable services, and also describes several realworld use cases that implement these concepts.
KW - High-performance computing
KW - In situ analysis
KW - Scientific visualization
KW - Visualization
UR - http://www.scopus.com/inward/record.url?scp=85107287979&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-63393-6_11
DO - 10.1007/978-3-030-63393-6_11
M3 - Conference contribution
AN - SCOPUS:85107287979
SN - 9783030633929
T3 - Communications in Computer and Information Science
SP - 157
EP - 174
BT - Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI - 17th Smoky Mountains Computational Sciences and Engineering Conference, SMC 2020, Revised Selected Papers
A2 - Nichols, Jeffrey
A2 - Maccabe, Arthur ‘Barney’
A2 - Parete-Koon, Suzanne
A2 - Verastegui, Becky
A2 - Hernandez, Oscar
A2 - Ahearn, Theresa
PB - Springer Science and Business Media Deutschland GmbH
T2 - 17th Smoky Mountains Computational Sciences and Engineering Conference, SMC 2020
Y2 - 26 August 2020 through 28 August 2020
ER -