More Like this

1. Neural-HATS: Neural Hybrid Approach for Time Series Causal Discovery

   Absar, Saima; Huang, Wen; Wu, Yongkai; Zhang, Lu (March 2025, AAAI'25 Workshop on Artificial Intelligence for Time Series Analysis (AI4TS))
2. The Causal-Neural Connection: Expressiveness, Learnability, and Inference

   Xia, Kevin; Lee, Kai-Zhan; Bengio, Yoshua; Bareinboim, Elias (January 2021, Advances in neural information processing systems)

   One of the central elements of any causal inference is an object called structural causal model (SCM), which represents a collection of mechanisms and exogenous sources of random variation of the system under investigation (Pearl, 2000). An important property of many kinds of neural networks is universal approximability: the ability to approximate any function to arbitrary precision. Given this property, one may be tempted to surmise that a collection of neural nets is capable of learning any SCM by training on data generated by that SCM. In this paper, we show this is not the case by disentangling the notions of expressivity and learnability. Specifically, we show that the causal hierarchy theorem (Thm. 1, Bareinboim et al., 2020), which describes the limits of what can be learned from data, still holds for neural models. For instance, an arbitrarily complex and expressive neural net is unable to predict the effects of interventions given observational data alone. Given this result, we introduce a special type of SCM called a neural causal model (NCM), and formalize a new type of inductive bias to encode structural constraints necessary for performing causal inferences. Building on this new class of models, we focus on solving two canonical tasks found in the literature known as causal identification and estimation. Leveraging the neural toolbox, we develop an algorithm that is both sufficient and necessary to determine whether a causal effect can be learned from data (i.e., causal identifiability); it then estimates the effect whenever identifiability holds (causal estimation). Simulations corroborate the proposed approach. 

   more » « less
3. Neural Causal Models for Counterfactual Identification and Estimation

   Xia, Kevin; Pan, Yushu; Bareinboim, Elias (April 2022, Proceedings of the 11th Eleventh International Conference on Learning Representations)
4. Neural Time-Invariant Causal Discovery from Time Series Data

   https://doi.org/10.1109/IJCNN54540.2023.10192004  

   Absar, Saima; Wu, Yongkai; Zhang, Lu (June 2023, IEEE)
5. Hybrid^2 Neural ODE Causal Modeling and an Application to Glycemic Response

   Zou, Bob J; Levine, Matthew E; Zaharieva, Dessi P; Johari, Ramesh; Fox, Emily B (July 2024, 41st International Conference on Machine Learning (ICML))

   Hybrid models composing mechanistic ODE- based dynamics with flexible and expressive neural network components have grown rapidly in popularity, especially in scientific domains where such ODE-based modeling offers important interpretability and validated causal grounding (e.g., for counterfactual reasoning). The incorporation of mechanistic models also provides inductive bias in standard blackbox modeling approaches, critical when learning from small datasets or partially observed, complex systems. Unfortunately, as the hybrid models become more flexible, the causal grounding provided by the mechanistic model can quickly be lost. We address this problem by leveraging another common source of domain knowledge: ranking of treatment effects for a set of interventions, even if the precise treatment effect is unknown. We encode this information in a causal loss that we combine with the standard predictive loss to arrive at a hybrid loss that biases our learning towards causally valid hybrid models. We demonstrate our ability to achieve a win-win, state-of-the-art predictive performance and causal validity, in the challenging task of modeling glucose dynamics post-exercise in individuals with type 1 diabetes. 

   more » « less