skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Variationally correct neural residual regression for parametric PDEs: on the viability of controlled accuracy
Abstract This paper is about learning the parameter-to-solution map for systems of partial differential equations (PDEs) that depend on a potentially large number of parameters covering all PDE types for which a stable variational formulation (SVF) can be found. A central constituent is the notion of variationally correct residual loss function, meaning that its value is always uniformly proportional to the squared solution error in the norm determined by the SVF, hence facilitating rigorous a posteriori accuracy control. It is based on a single variational problem, associated with the family of parameter-dependent fibre problems, employing the notion of direct integrals of Hilbert spaces. Since in its original form the loss function is given as a dual test norm of the residual; a central objective is to develop equivalent computable expressions. The first critical role is played by hybrid hypothesis classes, whose elements are piecewise polynomial in (low-dimensional) spatio-temporal variables with parameter-dependent coefficients that can be represented, for example, by neural networks. Second, working with first-order SVFs we distinguish two scenarios: (i) the test space can be chosen as an $$L_{2}$$-space (such as for elliptic or parabolic problems) so that residuals can be evaluated directly as elements of $$L_{2}$$; (ii) when trial and test spaces for the fibre problems depend on the parameters (as for transport equations) we use ultra-weak formulations. In combination with discontinuous Petrov–Galerkin concepts the hybrid format is then instrumental to arrive at variationally correct computable residual loss functions. Our findings are illustrated by numerical experiments representing (i) and (ii), namely elliptic boundary value problems with piecewise constant diffusion coefficients and pure transport equations with parameter-dependent convection fields.  more » « less
Award ID(s):
2038080 2245097 2012469
PAR ID:
10640145
Author(s) / Creator(s):
; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
IMA Journal of Numerical Analysis
ISSN:
0272-4979
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract In this paper, we propose a novel residual-based data-driven closure strategy for reduced order models (ROMs) of under-resolved, convection-dominated problems. The new ROM closure model is constructed in a variational multiscale (VMS) framework by using the available full order model data and a model form ansatz that depends on the ROM residual. We emphasize that this closure modeling strategy is fundamentally different from the current data-driven ROM closures, which generally depend on the ROM coefficients. We investigate the new residual-based data-driven VMS ROM closure strategy in the numerical simulation of three test problems: (i) a one-dimensional parameter-dependent advection-diffusion problem; (ii) a two-dimensional time-dependent advection-diffusion-reaction problem with a small diffusion coefficient ($$\varepsilon = 1e-4$$ ε = 1 e - 4 ); and (iii) a two-dimensional flow past a cylinder at Reynolds number$$Re=1000$$ R e = 1000 . Our numerical investigation shows that the new residual-based data-driven VMS-ROM is more accurate than the standard coefficient-based data-driven VMS-ROM. 
    more » « less
  2. The discontinuous Petrov–Galerkin (DPG) method is a Petrov–Galerkin finite element method with test functions designed for obtaining stability. These test functions are computable locally, element by element, and are motivated by optimal test functions which attain the supremum in an inf-sup condition. A profound consequence of the use of nearly optimal test functions is that the DPG method can inherit the stability of the (undiscretized) variational formulation, be it coercive or not. This paper combines a presentation of the fundamentals of the DPG ideas with a review of the ongoing research on theory and applications of the DPG methodology. The scope of the presented theory is restricted to linear problems on Hilbert spaces, but pointers to extensions are provided. Multiple viewpoints to the basic theory are provided. They show that the DPG method is equivalent to a method which minimizes a residual in a dual norm, as well as to a mixed method where one solution component is an approximate error representation function. Being a residual minimization method, the DPG method yields Hermitian positive definite stiffness matrix systems even for non-self-adjoint boundary value problems. Having a built-in error representation, the method has the out-of-the-box feature that it can immediately be used in automatic adaptive algorithms. Contrary to standard Galerkin methods, which are uninformed about test and trial norms, the DPG method must be equipped with a concrete test norm which enters the computations. Of particular interest are variational formulations in which one can tailor the norm to obtain robust stability. Key techniques to rigorously prove convergence of DPG schemes, including construction of Fortin operators, which in the DPG case can be done element by element, are discussed in detail. Pointers to open frontiers are presented. 
    more » « less
  3. We propose and investigate the application of alternative enriched test spaces in the discontinuous Petrov–Galerkin (DPG) finite element framework for singular perturbation linear problems, with an emphasis on 2D convection-dominated diffusion. Providing robust L2 error estimates for the field variables is considered a convenient feature for this class of problems, since this normwould not account for the large gradients present in boundary layers. With this requirement in mind, Demkowicz and others have previously formulated special test norms, which through DPG deliver the desired L2 convergence. However, robustness has only been verified through numerical experiments for tailored test normswhich are problem-specific,whereas the quasi-optimal test norm (not problem specific) has failed such tests due to the difficulty to resolve the optimal test functions sought in the DPG technology. To address this issue (i.e. improve optimal test functions resolution for the quasi-optimal test norm), we propose to discretize the local test spaces with functions that depend on the perturbation parameter ϵ. Explicitly,wework with B-spline spaces defined on an ϵ-dependent Shishkin submesh. Two examples are run using adaptive h-refinement to compare the performance of proposed test spaces with that of standard test spaces. We also include a modified norm and a continuation strategy aiming to improve time performance and briefly experiment with these ideas. 
    more » « less
  4. Trefftz schemes are high-order Galerkin methods whose discrete spaces are made of elementwise exact solutions of the underlying partial differential equation (PDE). Trefftz basis functions can be easily computed for many PDEs that are linear, homogeneous and have piecewise-constant coefficients. However, if the equation has variable coefficients, exact solutions are generally unavailable. Quasi-Trefftz methods overcome this limitation relying on elementwise ‘approximate solutions’ of the PDE, in the sense of Taylor polynomials. We define polynomial quasi-Trefftz spaces for general linear PDEs with smooth coefficients and source term, describe their approximation properties and, under a nondegeneracy condition, provide a simple algorithm to compute a basis. We then focus on a quasi-Trefftz DG method for variable-coefficient elliptic diffusion–advection–reaction problems, showing stability and high-order convergence of the scheme. The main advantage over standard DG schemes is the higher accuracy for comparable numbers of degrees of freedom. For nonhomogeneous problems with piecewise-smooth source term we propose to construct a local quasi-Trefftz particular solution and then solve for the difference. Numerical experiments in two and three space dimensions show the excellent properties of the method both in diffusion-dominated and advection-dominated problems. 
    more » « less
  5. The analyses of interior penalty discontinuous Galerkin methods of any order k for solving elliptic and parabolic problems with Dirac line sources are presented. For the steady state case, we prove convergence of the method by deriving a priori error estimates in the L 2 norm and in weighted energy norms. In addition, we prove almost optimal local error estimates in the energy norm for any approximation order. Further, almost optimal local error estimates in the L 2 norm are obtained for the case of piecewise linear approximations whereas suboptimal error bounds in the L 2 norm are shown for any polynomial degree. For the time-dependent case, convergence of semi-discrete and of backward Euler fully discrete scheme is established by proving error estimates in L 2 in time and in space. Numerical results for the elliptic problem are added to support the theoretical results. 
    more » « less