More Like this

1. Neural Latents Benchmark ‘21: Evaluating latent variable models of neural population activity

   https://doi.org/10.48550/arXiv.2109.04463  

   Felix Pei1∗, Joel Ye1 (January 2022, 35th Conference on Neural Information Processing Systems)

   Advances in neural recording present increasing opportunities to study neural activity in unprecedented detail. Latent variable models (LVMs) are promising tools for analyzing this rich activity across diverse neural systems and behaviors, as LVMs do not depend on known relationships between the activity and external experimental variables. However, progress with LVMs for neuronal population activity is currently impeded by a lack of standardization, resulting in methods being developed and compared in an ad hoc manner. To coordinate these modeling efforts, we introduce a benchmark suite for latent variable modeling of neural population activity. We curate four datasets of neural spiking activity from cognitive, sensory, and motor areas to promote models that apply to the wide variety of activity seen across these areas. We identify unsupervised evaluation as a common framework for evaluating models across datasets, and apply several baselines that demonstrate benchmark diversity. We release this benchmark through EvalAI. 

   more » « less
2. A probabilistic framework for task-aligned intra- and inter-area neural manifold estimation

   Balzani, Edoardo; Noel, Jean-Paul; Herrero-Vidal, Pedro; Angelaki, Dora E.; Savin, Cristina (February 2023, International Conference on Learning Representations 2023)

   Latent manifolds provide a compact characterization of neural population activity and of shared co-variability across brain areas. Nonetheless, existing statistical tools for extracting neural manifolds face limitations in terms of interpretability of latents with respect to task variables, and can be hard to apply to datasets with no trial repeats. Here we propose a novel probabilistic framework that allows for interpretable partitioning of population variability within and across areas in the context of naturalistic behavior. Our approach for task aligned manifold estimation (TAME-GP) extends a probabilistic variant of demixed PCA by (1) explicitly partitioning variability into private and shared sources, (2) using a Poisson noise model, and (3) introducing temporal smoothing of latent trajectories in the form of a Gaussian Process prior. This TAME-GP graphical model allows for robust estimation of task-relevant variability in local population responses, and of shared co-variability between brain areas. We demonstrate the efficiency of our estimator on within model and biologically motivated simulated data. We also apply it to neural recordings in a closed-loop virtual navigation task in monkeys, demonstrating the capacity of TAME-GP to capture meaningful intra- and inter-area neural variability with single trial resolution. 

   more » « less
3. Extracting task-relevant preserved dynamics from contrastive aligned neural recordings

   https://doi.org/10.1101/2025.11.11.686428  

   Jiang, Yiqi; Sheng, Kaiwen; Gao, Yujia; Buchanan, E Kelly; Shikano, Yu; Kim, Tony Hyun; Zhao, Yixiu; Woo, Seung Je; Dinc, Fatih; Linderman, Scott; et al (November 2025, bioRxiv)

   Abstract Recent work indicates that low-dimensional dynamics of neural and behavioral data are often preserved across days and subjects. However, extracting these preserved dynamics remains challenging: high-dimensional neural population activity and the recorded neuron populations vary across recording sessions. While existing modeling tools can improve alignment between neural and behavioral data, they often operate on a per-subject basis or discretize behavior into categories, disrupting its natural continuity and failing to capture the underlying dynamics. We introduceContrastiveAlignedNeuralDYnamics (CANDY), an end-to-end framework that aligns neural and behavioral data using rank-based contrastive learning, adapted for continuous behavioral variables, to project neural activity from different sessions onto a shared low-dimensional embedding space. CANDY fits a shared linear dynamical system to the aligned embeddings, enabling an interpretable model of the conserved temporal structure in the latent space. We validate CANDY on synthetic and real-world datasets spanning multiple species, behaviors, and recording modalities. Our results show that CANDY is able to learn aligned latent embeddings and preserved dynamics across neural recording sessions and subjects, and it achieves improved cross-session behavior decoding performance. We further show that the latent linear dynamical system generalizes to new sessions and subjects, achieving comparable or even superior behavior decoding performance to models trained from scratch. These advances enable robust cross-session behavioral decoding and offer a path towards identifying shared neural dynamics that underlie behavior across individuals and recording conditions. The code and two-photon imaging data of striatal neural activity that we acquired here are available athttps://github.com/schnitzer-lab/CANDY-public.git. 

   more » « less
4. Avalanche scaling in large neural populations with distributed coupling to multiple dynamical latent variables

   Morrell, Mia C.; Nemenman, Ilya; Sederberg, Audrey J. (January 2023, arXiv)

   Observations of power laws in neural activity data have raised the intriguing notion that brains may operate in a critical state. One example of this critical state is "avalanche criticality," which has been observed in a range of systems, including cultured neurons, zebrafish, and human EEG. More recently, power laws have also been observed in neural populations in the mouse under a coarse-graining procedure, and they were explained as a consequence of the neural activity being coupled to multiple latent dynamical variables. An intriguing possibility is that avalanche criticality emerges due to a similar mechanism. Here, we determine the conditions under which dynamical latent variables give rise to avalanche criticality. We find that a single, quasi-static latent variable can generate critical avalanches, but that multiple latent variables lead to critical behavior in a broader parameter range. We identify two regimes of avalanches, both of which are critical, but differ in the amount of information carried about the latent variable. Our results suggest that avalanche criticality arises in neural systems in which there is an emergent dynamical variable or shared inputs creating an effective latent dynamical variable, and when this variable can be inferred from the population activity. 

   more » « less
5. User-dependent neural sequence models for continuous-time event data

   Boyd, Alex; Bamler, Robert; Mandt, Stephan; Smyth, Padhraic (October 2020, Advances in neural information processing systems)

   Continuous-time event data are common in applications such as individual behavior data, financial transactions, and medical health records. Modeling such data can be very challenging, in particular for applications with many different types of events, since it requires a model to predict the event types as well as the time of occurrence. Recurrent neural networks that parameterize time-varying intensity functions are the current state-of-the-art for predictive modeling with such data. These models typically assume that all event sequences come from the same data distribution. However, in many applications event sequences are generated by different sources, or users, and their characteristics can be very different. In this paper, we extend the broad class of neural marked point process models to mixtures of latent embeddings, where each mixture component models the characteristic traits of a given user. Our approach relies on augmenting these models with a latent variable that encodes user characteristics, represented by a mixture model over user behavior that is trained via amortized variational inference. We evaluate our methods on four large real-world datasets and demonstrate systematic improvements from our approach over existing work for a variety of predictive metrics such as log-likelihood, next event ranking, and source-of-sequence identification. 

   more » « less