Moment representation in the lattice Boltzmann method on massively parallel hardware

Madhurima Vardhan; John Gounley; Luiz Hegele; Erik W. Draeger; Amanda Randles

doi:10.1145/3295500.3356204

Moment representation in the lattice Boltzmann method on massively parallel hardware

Madhurima Vardhan, John Gounley, Luiz Hegele, Erik W. Draeger, Amanda Randles

Scalable Biomedical Modeling

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

15 Scopus citations

Abstract

The widely-used lattice Boltzmann method (LBM) for computational fluid dynamics is highly scalable, but also significantly memory bandwidth-bound on current architectures. This paper presents a new regularized LBM implementation that reduces the memory footprint by only storing macroscopic, moment-based data. We show that the amount of data that must be stored in memory during a simulation is reduced by up to 47%. We also present a technique for cache-aware data re-utilization and show that optimizing cache utilization to limit data motion results in a similar improvement in time to solution. These new algorithms are implemented in the hemodynamics solver HARVEY and demonstrated using both idealized and realistic biological geometries. We develop a performance model for the moment representation algorithm and evaluate the performance on Summit.

Original language	English
Title of host publication	Proceedings of SC 2019
Subtitle of host publication	The International Conference for High Performance Computing, Networking, Storage and Analysis
Publisher	IEEE Computer Society
ISBN (Electronic)	9781450362290
DOIs	https://doi.org/10.1145/3295500.3356204
State	Published - Nov 17 2019
Event	2019 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019 - Denver, United States Duration: Nov 17 2019 → Nov 22 2019

Publication series

Name	International Conference for High Performance Computing, Networking, Storage and Analysis, SC
ISSN (Print)	2167-4329
ISSN (Electronic)	2167-4337

Conference

Conference	2019 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019
Country/Territory	United States
City	Denver
Period	11/17/19 → 11/22/19

Funding

This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan(http://energy.gov/downloads/doe-public-access-plan). This research used resources of the Oak Ridge Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC05-00OR22725. This work was performed under the auspices of the U.S. Department of Energy by LLNL under Contract DE-AC52-07NA27344. Support was provided by the LLNL Laboratory Directed Research and Development (LDRD) program. Research reported in this publication was supported by the Office of the Director, National Institutes Of Health under Award Number DP5OD019876. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Support was provided by the Hartwell Foundation and Duke Theo Pilkington Fellowship. We thank all the members of the Randlelab for their careful review and feedback on this work.

Funders	Funder number
DOE Office of Science User Facility supported	DE-AC05-00OR22725
LLC
Oak
UT-Battelle
National Institutes of Health	DP5OD019876
U.S. Department of Energy
Office of the Director
Lawrence Livermore National Laboratory	DE-AC52-07NA27344
Duke University
Hartwell Foundation
Laboratory Directed Research and Development

Keywords

Bandwidth
Lattice boltzmann method
Memory
Moment representation

Access to Document

10.1145/3295500.3356204

Cite this

Vardhan, M., Gounley, J., Hegele, L., Draeger, E. W., & Randles, A. (2019). Moment representation in the lattice Boltzmann method on massively parallel hardware. In Proceedings of SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis Article a34 (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). IEEE Computer Society. https://doi.org/10.1145/3295500.3356204

Vardhan, Madhurima ; Gounley, John ; Hegele, Luiz et al. / Moment representation in the lattice Boltzmann method on massively parallel hardware. Proceedings of SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society, 2019. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).

@inproceedings{1d69ef21e67a4b389f01e1125b0cf35f,

title = "Moment representation in the lattice Boltzmann method on massively parallel hardware",

abstract = "The widely-used lattice Boltzmann method (LBM) for computational fluid dynamics is highly scalable, but also significantly memory bandwidth-bound on current architectures. This paper presents a new regularized LBM implementation that reduces the memory footprint by only storing macroscopic, moment-based data. We show that the amount of data that must be stored in memory during a simulation is reduced by up to 47%. We also present a technique for cache-aware data re-utilization and show that optimizing cache utilization to limit data motion results in a similar improvement in time to solution. These new algorithms are implemented in the hemodynamics solver HARVEY and demonstrated using both idealized and realistic biological geometries. We develop a performance model for the moment representation algorithm and evaluate the performance on Summit.",

keywords = "Bandwidth, Lattice boltzmann method, Memory, Moment representation",

author = "Madhurima Vardhan and John Gounley and Luiz Hegele and Draeger, {Erik W.} and Amanda Randles",

note = "Publisher Copyright: {\textcopyright} 2019 ACM.; 2019 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019 ; Conference date: 17-11-2019 Through 22-11-2019",

year = "2019",

month = nov,

day = "17",

doi = "10.1145/3295500.3356204",

language = "English",

series = "International Conference for High Performance Computing, Networking, Storage and Analysis, SC",

publisher = "IEEE Computer Society",

booktitle = "Proceedings of SC 2019",

}

Vardhan, M, Gounley, J, Hegele, L, Draeger, EW & Randles, A 2019, Moment representation in the lattice Boltzmann method on massively parallel hardware. in Proceedings of SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis., a34, International Conference for High Performance Computing, Networking, Storage and Analysis, SC, IEEE Computer Society, 2019 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019, Denver, United States, 11/17/19. https://doi.org/10.1145/3295500.3356204

Moment representation in the lattice Boltzmann method on massively parallel hardware. / Vardhan, Madhurima; Gounley, John; Hegele, Luiz et al.
Proceedings of SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society, 2019. a34 (International Conference for High Performance Computing, Networking, Storage and Analysis, SC).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Moment representation in the lattice Boltzmann method on massively parallel hardware

AU - Vardhan, Madhurima

AU - Gounley, John

AU - Hegele, Luiz

AU - Draeger, Erik W.

AU - Randles, Amanda

PY - 2019/11/17

Y1 - 2019/11/17

N2 - The widely-used lattice Boltzmann method (LBM) for computational fluid dynamics is highly scalable, but also significantly memory bandwidth-bound on current architectures. This paper presents a new regularized LBM implementation that reduces the memory footprint by only storing macroscopic, moment-based data. We show that the amount of data that must be stored in memory during a simulation is reduced by up to 47%. We also present a technique for cache-aware data re-utilization and show that optimizing cache utilization to limit data motion results in a similar improvement in time to solution. These new algorithms are implemented in the hemodynamics solver HARVEY and demonstrated using both idealized and realistic biological geometries. We develop a performance model for the moment representation algorithm and evaluate the performance on Summit.

AB - The widely-used lattice Boltzmann method (LBM) for computational fluid dynamics is highly scalable, but also significantly memory bandwidth-bound on current architectures. This paper presents a new regularized LBM implementation that reduces the memory footprint by only storing macroscopic, moment-based data. We show that the amount of data that must be stored in memory during a simulation is reduced by up to 47%. We also present a technique for cache-aware data re-utilization and show that optimizing cache utilization to limit data motion results in a similar improvement in time to solution. These new algorithms are implemented in the hemodynamics solver HARVEY and demonstrated using both idealized and realistic biological geometries. We develop a performance model for the moment representation algorithm and evaluate the performance on Summit.

KW - Bandwidth

KW - Lattice boltzmann method

KW - Memory

KW - Moment representation

UR - http://www.scopus.com/inward/record.url?scp=85076139149&partnerID=8YFLogxK

U2 - 10.1145/3295500.3356204

DO - 10.1145/3295500.3356204

M3 - Conference contribution

AN - SCOPUS:85076139149

T3 - International Conference for High Performance Computing, Networking, Storage and Analysis, SC

BT - Proceedings of SC 2019

PB - IEEE Computer Society

T2 - 2019 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019

Y2 - 17 November 2019 through 22 November 2019

ER -

Vardhan M, Gounley J, Hegele L, Draeger EW, Randles A. Moment representation in the lattice Boltzmann method on massively parallel hardware. In Proceedings of SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE Computer Society. 2019. a34. (International Conference for High Performance Computing, Networking, Storage and Analysis, SC). doi: 10.1145/3295500.3356204

Moment representation in the lattice Boltzmann method on massively parallel hardware

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this