Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Swapnil Desai; Yu Jeong Kim; Wonsik Song; Minh Bau Luong; Francisco E. Hernández Pérez; Ramanan Sankaran; Hong G. Im

doi:10.1016/j.compfluid.2020.104787

Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Swapnil Desai, Yu Jeong Kim, Wonsik Song, Minh Bau Luong, Francisco E. Hernández Pérez, Ramanan Sankaran, Hong G. Im

Multiscale Materials

Research output: Contribution to journal › Article › peer-review

33 Scopus citations

Abstract

Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. The performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.

Original language	English
Article number	104787
Journal	Computers and Fluids
Volume	215
DOIs	https://doi.org/10.1016/j.compfluid.2020.104787
State	Published - Jan 30 2021

Funding

This work was sponsored by competitive research funding from King Abdullah University of Science and Technology (KAUST). This research used resources of the computer clusters at KAUST Supercomputing Laboratory (KSL), the Oak Ridge Leadership Computing Facility and the Compute Data and Environment for Science (CADES) at ORNL, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725 . Notice: This manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan http://energy.gov/downloads/doe-public-access-plan .

Funders	Funder number
Environment for Science
Oak Ridge National Laboratory
US Department of Energy
U.S. Department of Energy	DE-AC05-00OR22725
Office of Science
Cades Foundation
King Abdullah University of Science and Technology

Keywords

Compressible turbulence
Direct numerical simulation (DNS)
GPU computing
High performance computing (HPC)
Performance analysis
WENO

Access to Document

10.1016/j.compfluid.2020.104787

Cite this

@article{11c7eef99acb45acb42598c19c9826b2,

title = "Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration",

abstract = "Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. The performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.",

keywords = "Compressible turbulence, Direct numerical simulation (DNS), GPU computing, High performance computing (HPC), Performance analysis, WENO",

author = "Swapnil Desai and Kim, {Yu Jeong} and Wonsik Song and Luong, {Minh Bau} and {Hern{\'a}ndez P{\'e}rez}, {Francisco E.} and Ramanan Sankaran and Im, {Hong G.}",

note = "Publisher Copyright: {\textcopyright} 2020 Elsevier Ltd",

year = "2021",

month = jan,

day = "30",

doi = "10.1016/j.compfluid.2020.104787",

language = "English",

volume = "215",

journal = "Computers and Fluids",

issn = "0045-7930",

publisher = "Elsevier",

}

TY - JOUR

T1 - Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

AU - Desai, Swapnil

AU - Kim, Yu Jeong

AU - Song, Wonsik

AU - Luong, Minh Bau

AU - Hernández Pérez, Francisco E.

AU - Sankaran, Ramanan

AU - Im, Hong G.

PY - 2021/1/30

Y1 - 2021/1/30

N2 - Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. The performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.

AB - Compressible reacting flows may display sharp spatial variation related to shocks, contact discontinuities or reactive zones embedded within relatively smooth regions. The presence of such phenomena emphasizes the relevance of shock-capturing schemes such as the weighted essentially non-oscillatory (WENO) scheme as an essential ingredient of the numerical solver. However, these schemes are complex and have more computational cost than the simple high-order compact or non-compact schemes. In this paper, we present the implementation of a seventh-order, minimally-dissipative mapped WENO (WENO7M) scheme in a newly developed direct numerical simulation (DNS) code called KAUST Adaptive Reactive Flows Solver (KARFS). In order to make efficient use of the computer resources and reduce the solution time, without compromising the resolution requirement, the WENO routines are accelerated via graphics processing unit (GPU) computation. The performance characteristics and scalability of the code are studied using different grid sizes and block decomposition. The performance portability of KARFS is demonstrated on a variety of architectures including NVIDIA Tesla P100 GPUs and NVIDIA Kepler K20X GPUs. In addition, the capability and potential of the newly implemented WENO7M scheme in KARFS to perform DNS of compressible flows is also demonstrated with model problems involving shocks, isotropic turbulence, detonations and flame propagation into a stratified mixture with complex chemical kinetics.

KW - Compressible turbulence

KW - Direct numerical simulation (DNS)

KW - GPU computing

KW - High performance computing (HPC)

KW - Performance analysis

KW - WENO

UR - http://www.scopus.com/inward/record.url?scp=85097574480&partnerID=8YFLogxK

U2 - 10.1016/j.compfluid.2020.104787

DO - 10.1016/j.compfluid.2020.104787

M3 - Article

AN - SCOPUS:85097574480

SN - 0045-7930

VL - 215

JO - Computers and Fluids

JF - Computers and Fluids

M1 - 104787

ER -

Direct numerical simulations of turbulent reacting flows with shock waves and stiff chemistry using many-core/GPU acceleration

Abstract

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this