Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Integrating Hybrid Modeling and Multifidelity Approaches for Data-Driven Process Model Discovery
Modeling the non-linear dynamics of a system from measurement data accurately is an open challenge. Over the past few years, various tools such as SINDy and DySMHO have emerged as approaches to distill dynamics from data. However, challenges persist in accurately capturing dynamics of a system especially when the physical knowledge about the system is unknown. A promising solution is to use a hybrid paradigm, that combines mechanistic and black-box models to leverage their respective strengths. In this study, we combine a hybrid modeling paradigm with sparse regression, to develop and identify models simultaneously. Two methods are explored, considering varying complexities, data quality, and availability and by comparing different case studies. In the first approach, we integrate SINDy-discovered models with neural ODE structures, to model unknown physics. In the second approach, we employ Multifidelity Surrogate Models (MFSMs) to construct composite models comprised of SINDy-discovered models and error-correction models.  more » « less
Award ID(s):
1944678
PAR ID:
10595848
Author(s) / Creator(s):
;
Publisher / Repository:
Living Archive for Process Systems Engineering
Date Published:
Page Range / eLocation ID:
351 to 358
Format(s):
Medium: X
Location:
Breckenridge, Colorado, USA
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, PLOS Computational Biology)
    Alber, Mark (Ed.)
    Biological systems exhibit complex dynamics that differential equations can often adeptly represent. Ordinary differential equation models are widespread; until recently their construction has required extensive prior knowledge of the system. Machine learning methods offer alternative means of model construction: differential equation models can be learnt from data via model discovery using sparse identification of nonlinear dynamics (SINDy). However, SINDy struggles with realistic levels of biological noise and is limited in its ability to incorporate prior knowledge of the system. We propose a data-driven framework for model discovery and model selection using hybrid dynamical systems: partial models containing missing terms. Neural networks are used to approximate the unknown dynamics of a system, enabling the denoising of the data while simultaneously learning the latent dynamics. Simulations from the fitted neural network are then used to infer models using sparse regression. We show, via model selection, that model discovery using hybrid dynamical systems outperforms alternative approaches. We find it possible to infer models correctly up to high levels of biological noise of different types. We demonstrate the potential to learn models from sparse, noisy data in application to a canonical cell state transition using data derived from single-cell transcriptomics. Overall, this approach provides a practical framework for model discovery in biology in cases where data are noisy and sparse, of particular utility when the underlying biological mechanisms are partially but incompletely known. 
    more » « less
  2. ; ; ; (, Chaos: An Interdisciplinary Journal of Nonlinear Science)
    We propose a data-driven framework for learning reduced-order moment dynamics from partial differential equation (PDE)-governed systems using neural Ordinary Differential Equations (neural ODEs). In contrast to derivative-based methods, such as SINDy (Sparse Identification of Nonlinear Dynamics), which necessitate densely sampled data and are sensitive to noise, our approach based on neural ODEs directly models moment trajectories, enabling robust learning from sparse and potentially irregular time series. Using as an application platform the nonlinear Schrödinger equation, the framework accurately recovers governing moment dynamics when closure is available, even from limited, irregular, and noisy observations. For systems without analytical closure, we introduce a data-driven coordinate transformation strategy based on Stiefel manifold optimization, enabling the discovery of low-dimensional representations in which the moment dynamics become closed, facilitating interpretable and reliable modeling. We also explore cases where a closure model is not known, such as a Fisher–Kolmogorov–Petrovskii–Piskounov reaction–diffusion system. Here, we demonstrate that neural ODEs can still effectively approximate the unclosed moment dynamics and achieve superior extrapolation accuracy compared to physical-expert-derived ODE models. This advantage remains robust even under sparse and irregular sampling, highlighting the method’s robustness in data-limited settings. Our results highlight the neural ODE framework as a powerful and flexible tool for learning interpretable, low-dimensional moment dynamics in complex PDE-governed systems. 
    more » « less
  3. ; (, Journal of Physics: Complexity)
    This study presents a data-driven framework for modeling complex systems, with a specific emphasis on traffic modeling. Traditional methods in traffic modeling often rely on assumptions regarding vehicle interactions. Our approach comprises two steps: first, utilizing information- theoretic (IT) tools to identify interaction directions and candidate variables thus eliminating assumptions, and second, employing the sparse identification of nonlinear systems (SINDy) tool to establish functional relationships. We validate the framework’s efficacy using synthetic data from two distinct traffic models, while considering measurement noise. Results show that IT tools can reliably detect directions of interaction as well as instances of no interaction. SINDy proves instrumental in creating precise functional relationships and determining coefficients in tested models. The innovation of our framework lies in its ability to use data-driven approach to model traffic dynamics without relying on assumptions, thus offering applications in various complex systems beyond traffic. 
    more » « less
  4. ; ; ; (, Frontiers in Photonics)
    IntroductionThe moment quantities associated with the nonlinear Schrödinger equation offer important insights into the evolution dynamics of such dispersive wave partial differential equation (PDE) models. The effective dynamics of the moment quantities are amenable to both analytical and numerical treatments. MethodsIn this paper, we present a data-driven approach associated with the “Sparse Identification of Nonlinear Dynamics” (SINDy) to capture the evolution behaviors of such moment quantities numerically. Results and DiscussionOur method is applied first to some well-known closed systems of ordinary differential equations (ODEs) which describe the evolution dynamics of relevant moment quantities. Our examples are, progressively, of increasing complexity and our findings explore different choices within the SINDy library. We also consider the potential discovery of coordinate transformations that lead to moment system closure. Finally, we extend considerations to settings where a closed analytical form of the moment dynamics is not available. 
    more » « less
  5. ; ; (, 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE))
    A hybrid filtered basis function (FBF) approach is proposed in this paper for feedforward tracking control of linear systems with unmodeled nonlinear dynamics. Unlike most available tracking control techniques, the FBF approach is very versatile; it is applicable to any type of linear system, regardless of its underlying dynamics. The FBF approach expresses the control input to a system as a linear combination of basis functions with unknown coefficients. The basis functions are forward filtered through a linear model of the system's dynamics and the unknown coefficients are selected such that tracking error is minimized. The linear models used in existing implementations of the FBF approach are typically physics-based representations of the linear dynamics of a system. The proposed hybrid FBF approach expands the application of the FBF approach to systems with unmodeled nonlinearities by learning from data. A hybrid model is formulated by combining a physics-based model of the system's linear dynamics with a data-driven linear model that approximates the unmodeled nonlinear dynamics. The hybrid model is used online in receding horizon to compute optimal control commands that minimize tracking errors. The proposed hybrid FBF approach is shown in simulations on a model of a vibration-prone 3D printer to improve tracking accuracy by up to 65.4%, compared to an existing FBF approach that does not incorporate data. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email