An official website of the United States government
In this paper, we consider iterative methods based on sampling for computing solutions to separable nonlinear inverse problems where the entire dataset cannot be accessed or is not available all-at-once. In such scenarios (e.g., when massive amounts of data exceed memory capabilities or when data is being streamed), solving inverse problems, especially nonlinear ones, can be very challenging. We focus on separable nonlinear problems, where the objective function is nonlinear in one (typically small) set of parameters and linear in another (larger) set of parameters. For the linear problem, we describe a limited-memory sampled Tikhonov method, and for the nonlinear problem, we describe an approach to integrate the limited-memory sampled Tikhonov method within a nonlinear optimization framework. The proposed method is computationally efficient in that it only uses available data at any iteration to update both sets of parameters. Numerical experiments applied to massive super-resolution image reconstruction problems show the power of these methods.
more »
« less
Computational tools for inversion and uncertainty estimation in respirometry
In many physiological systems, real-time endogeneous and exogenous signals in living organisms provide critical information and interpretations of physiological functions; however, these signals or variables of interest are not directly accessible and must be estimated from noisy, measured signals. In this paper, we study an inverse problem of recovering gas exchange signals of animals placed in a flow-through respirometry chamber from measured gas concentrations. For large-scale experiments (e.g., long scans with high sampling rate) that have many uncertainties (e.g., noise in the observations or an unknown impulse response function), this is a computationally challenging inverse problem. We first describe various computational tools that can be used for respirometry reconstruction and uncertainty quantification when the impulse response function is known. Then, we address the more challenging problem where the impulse response function is not known or only partially known. We describe nonlinear optimization methods for reconstruction, where both the unknown model parameters and the unknown signal are reconstructed simultaneously. Numerical experiments show the benefits and potential impacts of these methods in respirometry.
more »
« less
- Award ID(s):
- 1654175
- PAR ID:
- 10285487
- Editor(s):
- Mariño, Inés P.
- Date Published:
- Journal Name:
- PLOS ONE
- Volume:
- 16
- Issue:
- 5
- ISSN:
- 1932-6203
- Page Range / eLocation ID:
- e0251926
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Computational inverse problems utilize a finite number of measurements to infer a discrete approximation of the unknown parameter function. With motivation from the setting of PDE-based optimization, we study the unique reconstruction of discretized inverse problems by examining the positivity of the Hessian matrix. What is the reconstruction power of a fixed number of data observations? How many parameters can one reconstruct? Here we describe a probabilistic approach, and spell out the interplay of the observation size (r) and the number of parameters to be uniquely identified (m). The technical pillar here is the random sketching strategy, in which the matrix concentration inequality and sampling theory are largely employed. By analyzing a randomly subsampled Hessian matrix, we attain a well-conditioned reconstruction problem with high probability. Our main theory is validated in numerical experiments, using an elliptic inverse problem as an example.more » « less
-
A basic tenet of linear invariant systems is that they are sufficiently described by either the impulse response function or the frequency transfer function. This implies that we can always obtain one from the other. However, when the transfer function contains uncanceled poles, the impulse function cannot be obtained by the standard inverse Fourier transform method. Specifically, when the input consists of a uniform train of pulses and the output sequence has a finite duration, the transfer function contains multiple poles on the unit cycle. We show how the impulse function can be obtained from the frequency transfer function for such marginally stable systems. We discuss three interesting discrete Fourier transform pairs that are used in demonstrating the equivalence of the impulse response and transfer functions for such systems. The Fourier transform pairs can be used to yield various trigonometric sums involving sinπk/NsinπLk/N, where k is the integer summing variable and N is a multiple of integer L.more » « less
-
Identifying Structural Brain Networks from Functional Connectivity: A Network Deconvolution ApproachWe address the problem of identifying structural brain networks from signals measured by resting-state functional magnetic resonance imaging (fMRI). To this end, we model functional brain activity as graph signals generated through a linear diffusion process on the unknown structural network. While this is admittedly an oversimplification of the complex mechanisms at work in the brain, recent studies have shown it is an accurate generative model for the second-order statistics of functional signals. We show the diffusion model implies that the signal covariance matrix (a.k.a. functional connectivity) is an unknown polynomial function of the structural network’s adjacency matrix. Accordingly, we advocate a network deconvolution approach whereby we: (i) use the fMRI signals to estimate the eigenvectors of the structural network from those of the empirical covariance; and (ii) solve a convex, sparsity-regularized inverse problem to recover the eigenvalues that were obscured by diffusion. The inferred structural networks capture some key patterns that match known pathology in attention deficit/hyper activity disorder. We also offer preliminary evidence supporting their role as potential biomarkers for subject diagnosis and classification.more » « less
-
Abstract In this work, we describe a new approach that uses variational encoder-decoder (VED) networks for efficient uncertainty quantification forgoal-orientedinverse problems. Contrary to standard inverse problems, these approaches are goal-oriented in that the goal is to estimate some quantities of interest (QoI) that are functions of the solution of an inverse problem, rather than the solution itself. Moreover, we are interested in computing uncertainty metrics associated with the QoI, thus utilizing a Bayesian approach for inverse problems that incorporates the prediction operator and techniques for exploring the posterior. This may be particularly challenging, especially for nonlinear, possibly unknown, operators and nonstandard prior assumptions. We harness recent advances in machine learning, i.e. VED networks, to describe a data-driven approach to large-scale inverse problems. This enables a real-time uncertainty quantification for the QoI. One of the advantages of our approach is that we avoid the need to solve challenging inversion problems by training a network to approximate the mapping from observations to QoI. Another main benefit is that we enable uncertainty quantification for the QoI by leveraging probability distributions in the latent and target spaces. This allows us to efficiently generate QoI samples and circumvent complicated or even unknown forward models and prediction operators. Numerical results from medical tomography reconstruction and nonlinear hydraulic tomography demonstrate the potential and broad applicability of the approach.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1371/journal.pone.0251926
