More Like this

1. Vector autoregression and envelope model: Vector autoregression and envelope model

   https://doi.org/10.1002/sta4.203  

   Wang, Lei; Ding, Shanshan (January 2018, Stat)

   null (Ed.)
2. An Unsaturated Hydraulic Conductivity Model Based on the Capillary Bundle Model, the Brooks‐Corey Model and Waxman‐Smits Model

   https://doi.org/10.1029/2022wr034186  

   Fu, Yongwei; Horton, Robert; Ren, Tusheng; Heitman, Joshua (June 2023, Water Resources Research)
3. Multiple Model Dynamic Mode Decomposition for Flowfield and Model Parameter Estimation

   https://doi.org/10.2514/6.2022-2427  

   Tsolovikos, Alexandros; Suryanarayanan, Saikishan; Bakolas, Efstathios; Goldstein, David B. (January 2022, AIAA SCITECH 2022 Forum)
4. Hybrid control for combining model-based and model-free reinforcement learning

   https://doi.org/10.1177/02783649221083331  

   Pinosky, Allison; Abraham, Ian; Broad, Alexander; Argall, Brenna; Murphey, Todd D (June 2022, The International Journal of Robotics Research)

   We develop an approach to improve the learning capabilities of robotic systems by combining learned predictive models with experience-based state-action policy mappings. Predictive models provide an understanding of the task and the dynamics, while experience-based (model-free) policy mappings encode favorable actions that override planned actions. We refer to our approach of systematically combining model-based and model-free learning methods as hybrid learning. Our approach efficiently learns motor skills and improves the performance of predictive models and experience-based policies. Moreover, our approach enables policies (both model-based and model-free) to be updated using any off-policy reinforcement learning method. We derive a deterministic method of hybrid learning by optimally switching between learning modalities. We adapt our method to a stochastic variation that relaxes some of the key assumptions in the original derivation. Our deterministic and stochastic variations are tested on a variety of robot control benchmark tasks in simulation as well as a hardware manipulation task. We extend our approach for use with imitation learning methods, where experience is provided through demonstrations, and we test the expanded capability with a real-world pick-and-place task. The results show that our method is capable of improving the performance and sample efficiency of learning motor skills in a variety of experimental domains. 

   more » « less
5. Data-driven model discovery and model selection for noisy biological systems

   https://doi.org/10.1371/journal.pcbi.1012762  

   Wu, Xiaojun; McDermott, MeiLu; MacLean, Adam L (January 2025, PLOS Computational Biology)

   Alber, Mark (Ed.)

   Biological systems exhibit complex dynamics that differential equations can often adeptly represent. Ordinary differential equation models are widespread; until recently their construction has required extensive prior knowledge of the system. Machine learning methods offer alternative means of model construction: differential equation models can be learnt from data via model discovery using sparse identification of nonlinear dynamics (SINDy). However, SINDy struggles with realistic levels of biological noise and is limited in its ability to incorporate prior knowledge of the system. We propose a data-driven framework for model discovery and model selection using hybrid dynamical systems: partial models containing missing terms. Neural networks are used to approximate the unknown dynamics of a system, enabling the denoising of the data while simultaneously learning the latent dynamics. Simulations from the fitted neural network are then used to infer models using sparse regression. We show, via model selection, that model discovery using hybrid dynamical systems outperforms alternative approaches. We find it possible to infer models correctly up to high levels of biological noise of different types. We demonstrate the potential to learn models from sparse, noisy data in application to a canonical cell state transition using data derived from single-cell transcriptomics. Overall, this approach provides a practical framework for model discovery in biology in cases where data are noisy and sparse, of particular utility when the underlying biological mechanisms are partially but incompletely known. 

   more » « less