The Finite-Difference Time-Domain (FDTD) method is a numerical modeling technique used by researchers as one of the most accurate methods to simulate the propagation of an electromagnetic wave through an object over time. Due to the nature of the method, FDTD can be computationally expensive when used in complex setting such as light propagation in highly heterogenous object such as the imaging process of tissues. In this paper, we explore a Deep Learning (DL) model that predicts the evolution of an electromagnetic field in a heterogeneous medium. In particular, modeling for propagation of a Gaussian beam in skin tissue layers. This is relevant for the characterization of microscopy imaging of tissues. Our proposed model named FDTD-net, is based on the U-net architecture, seems to perform the prediction of the electric field (EF) with good accuracy and faster when compared to the FDTD method. A dataset of different geometries was created to simulate the propagation of the electric field. The propagation of the electric field was initially generated using the traditional FDTD method. This data set was used for training and testing of the FDTD-net. The experiments show that the FDTD-net learns the physics related to the propagation of the source in the heterogeneous objects, and it can capture changes in the field due to changes in the object morphology. As a result, we present a DL model that can compute a propagated electric field in less time than the traditional method.
more »
« less
HoD-Net: High-Order Differentiable Deep Neural Networks and Applications
We introduce a deep architecture named HoD-Net to enable high-order differentiability for deep learning. HoD-Net is based on and generalizes the complex-step finite difference (CSFD) method. While similar to classic finite difference, CSFD approaches the derivative of a function from a higher-dimension complex domain, leading to highly accurate and robust differentiation computation without numerical stability issues. This method can be coupled with backpropagation and adjoint perturbation methods for an efficient calculation of high-order derivatives. We show how this numerical scheme can be leveraged in challenging deep learning problems, such as high-order network training, deep learning-based physics simulation, and neural differential equations.
more »
« less
- PAR ID:
- 10350317
- Date Published:
- Journal Name:
- Proceedings of the AAAI Conference on Artificial Intelligence
- Volume:
- 36
- Issue:
- 8
- ISSN:
- 2159-5399
- Page Range / eLocation ID:
- 8249 to 8258
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
A new high-order hybrid method integrating neural networks and corrected finite differences is developed for solving elliptic equations with irregular interfaces and discontinuous solutions. Standard fourth-order finite difference discretization becomes invalid near such interfaces due to the discontinuities and requires corrections based on Cartesian derivative jumps. In traditional numerical methods, such as the augmented matched interface and boundary (AMIB) method, these derivative jumps can be reconstructed via additional approximations and are solved together with the unknown solution in an iterative procedure. Nontrivial developments have been carried out in the AMIB method in treating sharply curved interfaces, which, however, may not work for interfaces with geometric singularities. In this work, machine learning techniques are utilized to directly predict these Cartesian derivative jumps without involving the unknown solution. To this end, physics-informed neural networks (PINNs) are trained to satisfy the jump conditions for both closed and open interfaces with possible geometric singularities. The predicted Cartesian derivative jumps can then be integrated in the corrected finite differences. The resulting discrete Laplacian can be efficiently solved by fast Poisson solvers, such as fast Fourier transform (FFT) and geometric multigrid methods, over a rectangular domain with Dirichlet boundary conditions. This hybrid method is both easy to implement and efficient. Numerical experiments in two and three dimensions demonstrate that the method achieves fourth-order accuracy for the solution and its derivatives.more » « less
-
Abstract We develop a new finite difference method for the wave equation in second order form. The finite difference operators satisfy a summation-by-parts (SBP) property. With boundary conditions and material interface conditions imposed weakly by the simultaneous-approximation-term (SAT) method, we derive energy estimates for the semi-discretization. In addition, error estimates are derived by the normal mode analysis. The proposed method is termed as energy-based because of its similarity with the energy-based discontinuous Galerkin method. When imposing the Dirichlet boundary condition and material interface conditions, the traditional SBP-SAT discretization uses a penalty term with a mesh-dependent parameter, which is not needed in our method. Furthermore, numerical dissipation can be added to the discretization through the boundary and interface conditions. We present numerical experiments that verify convergence and robustness of the proposed method.more » « less
-
Abstract Rational approximation recently emerged as an efficient numerical tool for the solution of exterior wave propagation problems. Currently, this technique is limited to wave media which are invariant along the main propagation direction. We propose a new model order reduction-based approach for compressing unbounded waveguides with layered inclusions. It is based on the solution of a nonlinear rational least squares problem using the RKFIT method. We show that approximants can be converted into an accurate finite difference representation within a rational Krylov framework. Numerical experiments indicate that RKFIT computes more accurate grids than previous analytic approaches and even works in the presence of pronounced scattering resonances. Spectral adaptation effects allow for finite difference grids with dimensions near or even below the Nyquist limit.more » « less
-
Machine-learning (ML) based discretization has been developed to simulate complex partial differential equations (PDEs) with tremendous success across various fields. These learned PDE solvers can effectively resolve the underlying solution structures of interest and achieve a level of accuracy which often requires an order-of-magnitude finer grid for a conventional numerical method using polynomial-based approximations. In a previous work [13], we introduced a learned finite volume discretization that further incorporates the semi-Lagrangian (SL) mechanism, enabling larger CFL numbers for stability. However, the efficiency and effectiveness of such a methodology heavily rely on the availability of abundant high-resolution training data, which can be prohibitively expensive to obtain. To address this challenge, in this paper, we propose a novel multifidelity MLbased SL method for transport equations. This method leverages a combination of a small amount of high-fidelity data and sufficient but cheaper low-fidelity data. The approach is designed based on a composite convolutional neural network architecture that explores the inherent correlation between high-fidelity and low-fidelity data. The proposed method demonstrates the capability to achieve a reasonable level of accuracy, particularly in scenarios where a single-fidelity model fails to generalize effectively. We further extend the method to the nonlinear Vlasov--Poisson system by employing high-order Runge--Kutta exponential integrators. A collection of numerical tests are provided to validate the efficiency and accuracy of the proposed method.more » « less
An official website of the United States government

