An official website of the United States government
The MFEM (Modular Finite Element Methods) library is a high-performance C++ library for finite element discretizations. MFEM supports numerous types of finite element methods and is the discretization engine powering many computational physics and engineering applications across a number of domains. This paper describes some of the recent research and development in MFEM, focusing on performance portability across leadership-class supercomputing facilities, including exascale supercomputers, as well as new capabilities and functionality, enabling a wider range of applications. Much of this work was undertaken as part of the Department of Energy’s Exascale Computing Project (ECP) in collaboration with the Center for Efficient Exascale Discretizations (CEED).
more »
« less
Efficient exascale discretizations: High-order finite element methods
Efficient exploitation of exascale architectures requires rethinking of the numerical algorithms used in many large-scale applications. These architectures favor algorithms that expose ultra fine-grain parallelism and maximize the ratio of floating point operations to energy intensive data movement. One of the few viable approaches to achieve high efficiency in the area of PDE discretizations on unstructured grids is to use matrix-free/partially assembled high-order finite element methods, since these methods can increase the accuracy and/or lower the computational time due to reduced data motion. In this paper we provide an overview of the research and development activities in the Center for Efficient Exascale Discretizations (CEED), a co-design center in the Exascale Computing Project that is focused on the development of next-generation discretization software and algorithms to enable a wide range of finite element applications to run efficiently on future hardware. CEED is a research partnership involving more than 30 computational scientists from two US national labs and five universities, including members of the Nek5000, MFEM, MAGMA and PETSc projects. We discuss the CEED co-design activities based on targeted benchmarks, miniapps and discretization libraries and our work on performance optimizations for large-scale GPU architectures. We also provide a broad overview of research and development activities in areas such as unstructured adaptive mesh refinement algorithms, matrix-free linear solvers, high-order data visualization, and list examples of collaborations with several ECP and external applications.
more »
« less
- Award ID(s):
- 1740250
- PAR ID:
- 10393173
- Author(s) / Creator(s):
- ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »
- Date Published:
- Journal Name:
- The international journal of high performance computing applications
- Volume:
- 35
- Issue:
- 6
- ISSN:
- 1094-3420
- Page Range / eLocation ID:
- 527-552
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In this paper, we describe the research and development activities in the Center for Efficient Exascale Discretization within the US Exascale Computing Project, targeting state-of-the-art high-order finite-element algorithms for high-order applications on GPU-accelerated platforms. We discuss the GPU developments in several components of the CEED software stack, including the libCEED, MAGMA, MFEM, libParanumal, and Nek projects. We report performance and capability improvements in several CEED-enabled applications on both NVIDIA and AMD GPU systems.more » « less
-
Wave propagation is fundamental to applications including natural resource exploration, nuclear fusion research, and military defense, among others. However, developing accurate and efficient numerical algorithms for solving time-harmonic wave propagation problems is notoriously difficult. One difficulty is that classical discretization techniques (e.g., Galerkin finite elements, finite difference, etc.) yield indefinite discrete systems that preclude the use of many scalable solution algorithms. Significant progress has been made to develop specialized preconditioners for high-frequency wave propagation problems but robust and scalable solvers for general problems, including non-homogenous media and complex geometries, remain elusive. An alternative approach is to use minimum residual discretization methods—that yield Hermitian positive-definite discrete systems—and may be amenable to more standard preconditioners. Indeed, popularization of the first-order system least-squares methodology (FOSLS) was driven by the applicability of geometric and algebraic multigrid to otherwise indefinite problems. However, for wave propagation problems, FOSLS is known to be highly dissipative and is thus less competitive in the high-frequency regime. The discontinuous Petrov–Galerkin (DPG) method of Demkowicz and Gopalakrishnan is a minimum residual finite element method with several additional attractive properties: mesh-independent stability, a built-in error indicator, and applicability to a number of variational formulations. In the context of high-frequency wave propagation, the ultraweak DPG formulation has been observed to produce pollution error roughly commensurate to Galerkin discretizations. DPG discretizations may thus deliver accuracy typical of classical discretization techniques, but result in Hermitian positive-definite discrete systems that are often more amenable to preconditioning. A multigrid preconditioner for DPG systems, developed in the dissertation work of S. Petrides, was shown to scale efficiently in a shared-memory implementation. The primary objective of this dissertation is development of an efficient, distributed implementation of the DPG multigrid solver (DPG-MG). The distributed DPG-MG solver developed in this work will be demonstrated to be massively scalable, enabling solution of three-dimensional problems with O(10¹²) degrees of freedom on up to 460 000 CPU cores, an unprecedented scale for high-frequency wave propagation. The scalability of the DPG-MG solver will be further combined with hp-adaptivity to enable efficient solution of challenging real-world high-frequency wave propagation problems including optical fiber modeling, simulation of RF heating in tokamak devices, and seismic simulation. These applications include complex three-dimensional geometries, heterogeneous and anisotropic media, and localized features; demonstrating the robustness and versatility of the solver and tools developed in this dissertation.more » « less
-
In this paper, we consider Maxwell’s equations in linear dispersive media described by a single-pole Lorentz model for electronic polarization. We study two classes of commonly used spatial discretizations: finite difference methods (FD) with arbitrary even order accuracy in space and high spatial order discontinuous Galerkin (DG) finite element methods. Both types of spatial discretizations are coupled with second order semi-implicit leap-frog and implicit trapezoidal temporal schemes. By performing detailed dispersion analysis for the semi-discrete and fully discrete schemes, we obtain rigorous quantification of the dispersion error for Lorentz dispersive dielectrics. In particular, comparisons of dispersion error can be made taking into account the model parameters, and mesh sizes in the design of the two types of schemes. This work is a continuation of our previous research on energy-stable numerical schemes for nonlinear dispersive optical media [6,7]. The results for the numerical dispersion analysis of the reduced linear model, considered in the present paper, can guide us in the optimal choice of discretization parameters for the more complicated and nonlinear models. The numerical dispersion analysis of the fully discrete FD and DG schemes, for the dispersive Maxwell model considered in this paper, clearly indicate the dependence of the numerical dispersion errors on spatial and temporal discretizations, their order of accuracy, mesh discretization parameters and model parameters. The results obtained here cannot be arrived at by considering discretizations of Maxwell’s equations in free space. In particular, our results contrast the advantages and disadvantages of using high order FD or DG schemes and leap-frog or trapezoidal time integrators over different frequency ranges using a variety of measuresmore » « less
-
Boundary element methods (BEM) have been successfully applied towards solving a broad array of complicated electromagnetic problems. Most BEM approaches rely on flat triangular discretizations and discretization via the Method of Moments (MoM) and low-order basis functions. Although more complicated from an implementation standpoint, it has been shown that high-order methods based on curvilinear patch mesh discretizations can significantly outperform low-order MoM in both accuracy and computational efficiency. In this work, we review a new high-order Nyström method based on using Chebyshev basis functions with curvilinear elements that we have recently developed, present a few scattering examples, and discuss related on-going and future work.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
