skip to main content


Title: Iterative Global Sensitivity Analysis Algorithm with Neural Network Surrogate Modeling
Global sensitivity analysis (GSA) is a method to quantify the effect of the input parameters on outputs of physics-based systems. Performing GSA can be challenging due to the combined effect of the high computational cost of each individual physics-based model, a large number of input parameters, and the need to perform repetitive model evaluations. To reduce this cost, neural networks (NNs) are used to replace the expensive physics-based model in this work. This introduces the additional challenge of finding the minimum number of training data samples required to train the NNs accurately. In this work, a new method is introduced to accurately quantify the GSA values by iterating over both the number of samples required to train the NNs, terminated using an outer-loop sensitivity convergence criteria, and the number of model responses required to calculate the GSA, terminated with an inner-loop sensitivity convergence criteria. The iterative surrogate-based GSA guarantees converged values for the Sobol’ indices and, at the same time, alleviates the specification of arbitrary accuracy metrics for the surrogate model. The proposed method is demonstrated in two cases, namely, an eight-variable borehole function and a three-variable nondestructive testing (NDT) case. For the borehole function, both the first- and total-order Sobol’ indices required 200 and 105 data points to terminate on the outer- and inner-loop sensitivity convergence criteria, respectively. For the NDT case, these values were 100 for both first- and total-order indices for the outer-loop sensitivity convergence, and 106 and 103 for the inner-loop sensitivity convergence, respectively, for the first- and total-order indices, on the inner-loop sensitivity convergence. The differences of the proposed method with GSA on the true functions are less than 3% in the analytical case and less than 10% in the physics-based case (where the large error comes from small Sobol’ indices).  more » « less
Award ID(s):
1739551
NSF-PAR ID:
10297669
Author(s) / Creator(s):
; ; ; ;
Editor(s):
Paszynski, M.; Kranzlmüller, D.; Krzhizhanovskaya, V.V.; Dongarra, J.J.; Sloot, P.M.
Date Published:
Journal Name:
Computational Science – ICCS 2021. ICCS 2021. Lecture Notes in Computer Science
Volume:
12745
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The complexity and size of state-of-the-art cell models have significantly increased in part due to the requirement that these models possess complex cellular functions which are thought—but not necessarily proven—to be important. Modern cell mod- els often involve hundreds of parameters; the values of these parameters come, more often than not, from animal experiments whose relationship to the human physiology is weak with very little information on the errors in these measurements. The concomi- tant uncertainties in parameter values result in uncertainties in the model outputs or quantities of interest (QoIs). Global sensitivity analysis (GSA) aims at apportioning to individual parameters (or sets of parameters) their relative contribution to output uncer- tainty thereby introducing a measure of influence or importance of said parameters. New GSA approaches are required to deal with increased model size and complexity; a three-stage methodology consisting of screening (dimension reduction), surrogate modeling, and computing Sobol’ indices, is presented. The methodology is used to analyze a physiologically validated numerical model of neurovascular coupling which possess 160 uncertain parameters. The sensitivity analysis investigates three quantities of interest, the average value of K+ in the extracellular space, the average volumetric flow rate through the perfusing vessel, and the minimum value of the actin/myosin complex in the smooth muscle cell. GSA provides a measure of the influence of each parameter, for each of the three QoIs, giving insight into areas of possible physiological dysfunction and areas of further investigation. 
    more » « less
  2. null (Ed.)
    Abstract The objective of this work is to reduce the cost of performing model-based sensitivity analysis for ultrasonic nondestructive testing systems by replacing the accurate physics-based model with machine learning (ML) algorithms and quickly compute Sobol’ indices. The ML algorithms considered in this work are neural networks (NNs), convolutional NN (CNNs), and deep Gaussian processes (DGPs). The performance of these algorithms is measured by the root mean-squared error on a fixed number of testing points and by the number of high-fidelity samples required to reach a target accuracy. The algorithms are compared on three ultrasonic testing benchmark cases with three uncertainty parameters, namely, spherically void defect under a focused and a planar transducer and spherical-inclusion defect under a focused transducer. The results show that NNs required 35, 100, and 35 samples for the three cases, respectively. CNNs required 35, 100, and 56, respectively, while DGPs required 84, 84, and 56, respectively. 
    more » « less
  3. The focus of this paper is on the global sensitivity analysis (GSA) of linear systems with time-invariant model parameter uncertainties and driven by stochastic inputs. The Sobol' indices of the evolving mean and variance estimates of states are used to assess the impact of the time-invariant uncertain model parameters and the statistics of the stochastic input on the uncertainty of the output. Numerical results on two benchmark problems help illustrate that it is conceivable that parameters, which are not so significant in contributing to the uncertainty of the mean, can be extremely significant in contributing to the uncertainty of the variances. The paper uses a polynomial chaos (PC) approach to synthesize a surrogate probabilistic model of the stochastic system after using Lagrange interpolation polynomials (LIPs) as PC bases. The Sobol' indices are then directly evaluated from the PC coefficients. Although this concept is not new, a novel interpretation of stochastic collocation-based PC and intrusive PC is presented where they are shown to represent identical probabilistic models when the system under consideration is linear. This result now permits treating linear models as black boxes to develop intrusive PC surrogates. 
    more » « less
  4. Abstract

    Modeling the impact of space weather events such as coronal mass ejections (CMEs) is crucial to protecting critical infrastructure. The Space Weather Modeling Framework is a state‐of‐the‐art framework that offers full Sun‐to‐Earth simulations by computing the background solar wind, CME propagation, and magnetospheric impact. However, reliable long‐term predictions of CME events require uncertainty quantification (UQ) and data assimilation. We take the first steps by performing global sensitivity analysis (GSA) and UQ for background solar wind simulations produced by the Alfvén Wave Solar atmosphere Model (AWSoM) for two Carrington rotations: CR2152 (solar maximum) and CR2208 (solar minimum). We conduct GSA by computing Sobol' indices that quantify contributions from model parameter uncertainty to the variance of solar wind speed and density at 1 au, both crucial quantities for CME propagation and strength. Sobol' indices also allow us to rank and retain only the most important parameters, which aids in the construction of smaller ensembles for the reduced‐dimension parameter space. We present an efficient procedure for computing the Sobol' indices using polynomial chaos expansion surrogates and space‐filling designs. The PCEs further enable inexpensive forward UQ. Overall, we identify three important model parameters: the multiplicative factor applied to the magnetogram, Poynting flux per magnetic field strength constant used at the inner boundary, and the coefficient of the perpendicular correlation length in the turbulent cascade model in AWSoM.

     
    more » « less
  5. Global sensitivity analysis (GSA) of distribution system with respect to stochastic PV variations plays an important role in designing optimal voltage control schemes. This paper proposes a Kriging, i.e., Gaussian process modeling enabled data-driven GSA method. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol index can be conveniently calculated to assess the global sensitivity of voltage to various power injection variations. Comparison results with other model-based GSA methods on the IEEE 37-bus feeder, such as the polynomial chaos expansion and the Monte Carlo approaches demonstrate that the proposed method can achieve accurate GSA outcomes while maintaining high computational efficiency. 
    more » « less