Multilevel techniques for compression and reduction of scientific data-the multivariate case

Mark Ainsworth, Ozan Tugluk, Ben Whitney, Scott Klasky

Research output: Contribution to journalArticlepeer-review

58 Scopus citations

Abstract

We develop a technique for multigrid adaptive reduction of data (MGARD). Special attention is given to the case of tensor product grids, where our approach permits the use of nonuniformly spaced grids in each direction, which can prove problematic for many types of data reduction methods. An important feature of our approach is the provision of guaranteed, computable bounds on the loss incurred by the reduction of the data. Many users are leery of lossy algorithms and will only consider using them provided that numerical bounds on the pointwise difference between the original and the reduced datasets are given. Accordingly, we develop techniques for bounding the loss measured in the L(Ω) norm, and we show that these bounds are realistic in the sense that they do not significantly overestimate the actual loss. The resulting loss indicators are used to guide the adaptive reduction of the data so that the reduced dataset meets a user-prescribed tolerance or memory constraint. Illustrative numerical examples, including the reduction of data arising from the simulation of a nonlinear reaction-diffusion problem, a turbulent channel flow, and a climate simulation, are provided.

Original languageEnglish
Pages (from-to)A1278-A1303
JournalSIAM Journal on Scientific Computing
Volume41
Issue number2
DOIs
StatePublished - 2019

Funding

This work was partially supported by the Exascale Computing Project (17-SC-20-SC) of the U.S. Department of Energy; the Advanced Scientific Research Office (ASCR) at the Department of Energy, under contract DE-AC02-06CH11357; the DOE Storage Systems and Input/Output for Extreme Scale Science project, announcement number LAB 15-1338; and DOE and UT-Battelle, LLC, contract number DE-AC05-00OR22725. ∗Submitted to the journal’s Methods and Algorithms for Scientific Computing section January 23, 2018; accepted for publication (in revised form) February 12, 2019; published electronically April 25, 2019. http://www.siam.org/journals/sisc/41-2/M116665.html Funding: This work was partially supported by the Exascale Computing Project (17-SC-20-SC) of the U.S. Department of Energy; the Advanced Scientific Research Office (ASCR) at the Department of Energy, under contract DE-AC02-06CH11357; the DOE Storage Systems and Input/Output for Extreme Scale Science project, announcement number LAB 15-1338; and DOE and UT–Battelle, LLC, contract number DE-AC05-00OR22725.

FundersFunder number
Advanced Scientific Research Office
U.S. Department of EnergyDE-AC02-06CH11357
BattelleDE-AC05-00OR22725
Myelin Project17-SC-20-SC
Adobe Systems
AOL
Advanced Scientific Computing Research

    Keywords

    • Adaptive reduction
    • Data compression
    • Data reduction

    Fingerprint

    Dive into the research topics of 'Multilevel techniques for compression and reduction of scientific data-the multivariate case'. Together they form a unique fingerprint.

    Cite this