Tackling the Curse of Dimensionality with Physics-Informed Neural Networks

[Submitted on 23 Jul 2023 (v1), last revised 9 Aug 2023 (this version, v3)]

Title:Tackling the Curse of Dimensionality with Physics-Informed Neural Networks

Download a PDF of the paper titled Tackling the Curse of Dimensionality with Physics-Informed Neural Networks, by Zheyuan Hu and 3 other authors

Download PDF

Abstract: The curse-of-dimensionality (CoD) taxes computational resources heavily with exponentially increasing computational cost as the dimension increases. This poses great challenges in solving high-dimensional PDEs as Richard Bellman first pointed out over 60 years ago. While there has been some recent success in solving numerically partial differential equations (PDEs) in high dimensions, such computations are prohibitively expensive, and true scaling of general nonlinear PDEs to high dimensions has never been achieved. In this paper, we develop a new method of scaling up physics-informed neural networks (PINNs) to solve arbitrary high-dimensional PDEs. The new method, called Stochastic Dimension Gradient Descent (SDGD), decomposes a gradient of PDEs into pieces corresponding to different dimensions and samples randomly a subset of these dimensional pieces in each iteration of training PINNs. We theoretically prove the convergence guarantee and other desired properties of the proposed method. We experimentally demonstrate that the proposed method allows us to solve many notoriously hard high-dimensional PDEs, including the Hamilton-Jacobi-Bellman (HJB) and the Schrödinger equations in thousands of dimensions very fast on a single GPU using the PINNs mesh-free approach. For instance, we solve nontrivial nonlinear PDEs (one HJB equation and one Black-Scholes equation) in 100,000 dimensions in 6 hours on a single GPU using SDGD with PINNs. Since SDGD is a general training methodology of PINNs, SDGD can be applied to any current and future variants of PINNs to scale them up for arbitrary high-dimensional PDEs.

Submission history

From: Zheyuan Hu [view email]

[v1] Sun, 23 Jul 2023 12:18:12 UTC (1,959 KB)

[v2] Mon, 7 Aug 2023 08:36:45 UTC (2,547 KB)

[v3] Wed, 9 Aug 2023 05:19:06 UTC (2,547 KB)

from Hacker News https://ift.tt/iKrNWV9