skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Symmetric Neural Network to Compute Fractional Derivatives by Training with Integer Derivatives
Fractional calculus is an increasingly recognized important tool for modeling complicated dynamics in modern engineering systems. While, in some ways, fractional derivatives are a straight-forward generalization of integer-order derivatives that are ubiquitous in engineering modeling, in other ways the use of them requires quite a bit of mathematical expertise and familiarity with some mathematical concepts that are not in everyday use across the broad spectrum of engineering disciplines. In more colloquial terms, the learning curve is steep. While the authors recognize the need for fundamental competence in tools used in engineering, a computational tool that can provide an alternative means to compute fractional derivatives does have a useful role in engineering modeling. This paper presents the use of a symmetric neural network that is trained entirely on integer-order derivatives to provide a means to compute fractional derivatives. The training data does not contain any fractional-order derivatives at all, and is composed of only integer-order derivatives. The means by which a fractional derivative can be obtained is by requiring the neural network to be symmetric, that is, it is the composition of two identical sets of layers trained on integer-order derivatives. From that, the information contained in the nodes between the two sets of layers contains half-order derivative information  more » « less
Award ID(s):
1826079
PAR ID:
10328631
Author(s) / Creator(s):
;
Date Published:
Journal Name:
2022 IEEE/SICE International Symposium on System Integration (SII)
Page Range / eLocation ID:
291 to 296
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Dielectric elastomers are employed for a wide variety of adaptive structures. Many of these soft elastomers exhibit significant rate-dependencies in their response. Accurately quantifying this viscoelastic behavior is non-trivial and in many cases a nonlinear modeling framework is required. Fractional-order operators have been applied to modeling viscoelastic behavior for many years, and recent research has shown fractional-order methods to be effective for nonlinear frameworks. This implementation can become computationally expensive to achieve an accurate approximation of the fractional-order derivative. Accurate estimation of the elastomer’s viscoelastic behavior to quantify parameter uncertainty motivates the use of Markov Chain Monte Carlo (MCMC) methods. Since MCMC is a sampling based method, requiring many model evaluations, efficient estimation of the fractional derivative operator is crucial. In this paper, we demonstrate the effectiveness of using quadrature techniques to approximate the Riemann–Liouville definition for fractional derivatives in the context of estimating the uncertainty of a nonlinear viscoelastic model. We also demonstrate the use of parameter subset selection techniques to isolate parameters that are identifiable in the sense that they are uniquely determined by measured data. For those identifiable parameters, we employ Bayesian inference to compute posterior distributions for parameters. Finally, we propagate parameter uncertainties through the models to compute prediction intervals for quantities of interest. 
    more » « less
  2. null (Ed.)
    This paper presents a self-contained new theory of weak fractional differential calculus in one-dimension. The crux of this new theory is the introduction of a weak fractional derivative notion which is a natural generalization of integer order weak derivatives; it also helps to unify multiple existing fractional derivative definitions and characterize what functions are fractionally differentiable. Various calculus rules including a fundamental theorem calculus, product and chain rules, and integration by parts formulas are established for weak fractional derivatives. Additionally, relationships with classical fractional derivatives and detailed characterizations of weakly fractional differentiable functions are also established. Furthermore, the notion of weak fractional derivatives is also systematically extended to general distributions instead of only to some special distributions. This new theory lays down a solid theoretical foundation for systematically and rigorously developing new theories of fractional Sobolev spaces, fractional calculus of variations, and fractional PDEs as well as their numerical solutions in subsequent works. 
    more » « less
  3. Abstract Developing constitutive models that can describe a complex fluid’s response to an applied stimulus has been one of the critical pursuits of rheologists. The complexity of the models typically goes hand-in-hand with that of the observed behaviors and can quickly become prohibitive depending on the choice of materials and/or flow protocols. Therefore, reducing the number of fitting parameters by seeking compact representations of those constitutive models can obviate extra experimentation to confine the parameter space. To this end, fractional derivatives in which the differential response of matter accepts non-integer orders have shown promise. Here, we develop neural networks that are informed by a series of different fractional constitutive models. These fractional rheology-informed neural networks (RhINNs) are then used to recover the relevant parameters (fractional derivative orders) of three fractional viscoelastic constitutive models, i.e., fractional Maxwell, Kelvin-Voigt, and Zener models. We find that for all three studied models, RhINNs recover the observed behavior accurately, although in some cases, the fractional derivative order is recovered with significant deviations from what is known as ground truth. This suggests that extra fractional elements are redundant when the material response is relatively simple. Therefore, choosing a fractional constitutive model for a given material response is contingent upon the response complexity, as fractional elements embody a wide range of transient material behaviors. 
    more » « less
  4. Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy physics. However, the pathwise derivative estimator can be biased if there are discontinuities in the program, which may diminish its value for applications. This work integrates algorithmic differentiation into the electromagnetic shower simulation code HepEmShow based on G4HepEm, allowing us to study how well pathwise derivatives approximate derivatives of energy depositions in a sampling calorimeter with respect to parameters of the beam and geometry. We found that when multiple scattering is disabled in the simulation, means of pathwise derivatives converge quickly to their expected values, and these are close to the actual derivatives of the energy deposition. Additionally, we demonstrate the applicability of this novel gradient estimator for stochastic gradient-based optimization in a model example. 
    more » « less
  5. Integer-order calculus fails to capture the long-range dependence (LRD) and memory effects found in many complex systems. Fractional calculus addresses these gaps through fractional-order integrals and derivatives, but fractional-order dynamical systems pose substantial challenges in system identification and optimal control tasks. In this paper, we theoretically derive the optimal control via linear quadratic regulator (LQR) for fractional-order linear time-invariant (FOLTI) systems and develop an end-to-end deep learning framework based on this theoretical foundation. Our approach establishes a rigorous mathematical model, derives analytical solutions, and incorporates deep learning to achieve data-driven optimal control of FOLTI systems. Our key contributions include: (i) proposing a novel method for system identification and optimal control strategy in FOLTI systems, (ii) developing the first end-to-end data-driven learning framework, Fractional-Order Learning for Optimal Control (FOLOC), that learns control policies from observed trajectories, and (iii) deriving theoretical bounds on the sample complexity for learning accurate control policies under fractional-order dynamics. Experimental results indicate that our method accurately approximates fractional-order system behaviors without relying on Gaussian noise assumptions, pointing to promising avenues for advanced optimal control. 
    more » « less