nPINNs: Nonlocal physics-informed neural networks for a parametrized nonlocal universal Laplacian operator. Algorithms and applications

G. Pang, M. D'Elia, M. Parks, G. E. Karniadakis

Research output: Contribution to journalArticlepeer-review

98 Scopus citations

Abstract

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multi-fidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius δ goes to zero, and to the fractional Laplacian as δ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We provide theoretical convergence rates with respect to δ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, δ and α, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order α(y), which is more suitable for modeling wall-bounded turbulence, e.g. turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as δ. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

Original languageEnglish
Article number109760
JournalJournal of Computational Physics
Volume422
DOIs
StatePublished - Dec 1 2020
Externally publishedYes

Funding

This work was supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research under the Physics-Informed Learning Machines for Multiscale and Multiphysics Problems (PhILMs) project. GP and GK are also supported by the MURI/ARO at Brown University (W911NF-15-1-0562) and DARPA-AIRA (HR00111990025). MD and MP are also supported by Sandia National Laboratories (SNL). SNL is a multimission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC. a wholly owned subsidiary of Honeywell International, Inc. for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA-0003525. The authors would like to thank Pavan Pranjivan Mehta (Brown University) for useful discussion on connections and possible extensions to tempered fractional derivatives. This paper describes objective technical results and analysis. Any subjective views or opinions that might be expressed in the paper do not necessarily represent the views of the U.S. Department of Energy or the United States Government. Report number SAND2020-3980. This work was supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research under the Physics-Informed Learning Machines for Multiscale and Multiphysics Problems (PhILMs) project . GP and GK are also supported by the MURI/ARO at Brown University ( W911NF-15-1-0562 ) and DARPA-AIRA ( HR00111990025 ). MD and MP are also supported by Sandia National Laboratories (SNL). SNL is a multimission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA-0003525.

FundersFunder number
DARPA-AIRAHR00111990025
U.S. Department of Energy
Army Research Office
Office of Science
National Nuclear Security AdministrationSAND2020-3980, DE-NA-0003525
National Nuclear Security Administration
Advanced Scientific Computing Research
Sandia National Laboratories
Brown UniversityW911NF-15-1-0562
Brown University
Multidisciplinary University Research Initiative

    Keywords

    • Deep learning
    • Fractional Laplacian
    • Nonlocal models
    • Physics-informed neural networks
    • Turbulence modeling

    Fingerprint

    Dive into the research topics of 'nPINNs: Nonlocal physics-informed neural networks for a parametrized nonlocal universal Laplacian operator. Algorithms and applications'. Together they form a unique fingerprint.

    Cite this