Hybrid Approaches for Data Reduction of Spatiotemporal Scientific Applications

Xiao Li, Qian Gong, Jaemoon Lee, Scott Klasky, Anand Rangarajan, Sanjay Ranka

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Scientists conduct large-scale simulations to compute derived quantities from primary data. Thus, it is crucial that data compression techniques maintain bounded errors on these derived quantities or quantities of interest (QOI). For many spatiotemporal applications, these QOIs are binary in nature and represent presence or absence of a physical phenomenon. In this work, we propose to use a hybrid approah for differential compression for such applications. We use a neural network (NN) approach to determine regions-of-interest (ROIs) where the binary QOIs are going to be prevalent. This is then used with traditional approaches that compress at a lower level (and higher accuracy) for these ROIs as compared to other regions.

Original languageEnglish
Title of host publicationProceedings - DCC 2024
Subtitle of host publication2024 Data Compression Conference
EditorsAli Bilgin, James E. Fowler, Joan Serra-Sagrista, Yan Ye, James A. Storer
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages567
Number of pages1
ISBN (Electronic)9798350385878
DOIs
StatePublished - 2024
Event2024 Data Compression Conference, DCC 2024 - Snowbird, United States
Duration: Mar 19 2024Mar 22 2024

Publication series

NameData Compression Conference Proceedings
ISSN (Print)1068-0314

Conference

Conference2024 Data Compression Conference, DCC 2024
Country/TerritoryUnited States
CitySnowbird
Period03/19/2403/22/24

Fingerprint

Dive into the research topics of 'Hybrid Approaches for Data Reduction of Spatiotemporal Scientific Applications'. Together they form a unique fingerprint.

Cite this