An official website of the United States government
Generative models, such as Variational Autoencoders (VAEs), are increasingly employed for atypical pattern detection in brain imaging. During training, these models learn to capture the underlying patterns within “normal” brain images and generate new samples from those patterns. Neurodivergent states can be observed by measuring the dissimilarity between the generated/reconstructed images and the input images. This paper leverages VAEs to conduct Functional Connectivity (FC) analysis from functional Magnetic Resonance Imaging (fMRI) scans of individuals with Autism Spectrum Disorder (ASD), aiming to uncover atypical interconnectivity between brain regions. In the first part of our study, we compare multiple VAE architectures—Conditional VAE, Recurrent VAE, and a hybrid of CNN parallel with RNN VAE—aiming to establish the effectiveness of VAEs in application FC analysis. Given the nature of the disorder, ASD exhibits a higher prevalence among males than females. Therefore, in the second part of this paper, we investigate if introducing phenotypic data could improve the performance of VAEs and, consequently, FC analysis. We compare our results with the findings from previous studies in the literature. The results showed that CNN-based VAE architecture is more effective for this application than the other models.
more »
« less
A Trifecta of Deep Learning Models: Assessing Brain Health by Integrating Assessment and Neuroimaging Data
The investigation of brain health development is paramount, as a healthy brain underpins cognitive and physical well-being, and mitigates cognitive decline, neurodegenerative diseases, and mental health disorders. This study leverages the UK Biobank dataset containing static functional network connectivity (sFNC) data derived from resting-state functional magnetic resonance imaging (rs-fMRI) and assessment data. We introduce a novel approach to forecasting a brain health index (BHI) by deploying three distinct models, each capitalizing on different modalities for training and testing. The first model exclusively employs psychological assessment measures, while the second model harnesses both neuroimaging and assessment data for training but relies solely on assessment data during testing. The third model encompasses a holistic strategy, utilizing neuroimaging and assessment data for the training and testing phases. The proposed models employ a two-step approach for calculating the BHI. In the first step, the input data is subjected to dimensionality reduction using principal component analysis (PCA) to identify critical patterns and extract relevant features. The resultant concatenated feature vector is then utilized as input to variational autoencoders (VAE). This network generates a low-dimensional representation of the input data used for calculating BHI in new subjects without requiring imaging data. The results suggest that incorporating neuroimaging data into the BHI model, even when predicting from assessments alone, enhances its ability to accurately evaluate brain health. The VAE model exemplifies this improvement by reconstructing the sFNC matrix more accurately than the assessment data. Moreover, these BHI models also enable us to identify distinct behavioral and neural patterns. Hence, this approach lays the foundation for larger-scale efforts to monitor and enhance brain health, aiming to build resilient brain systems.
more »
« less
- PAR ID:
- 10514844
- Publisher / Repository:
- Organization for Human Brain Mapping
- Date Published:
- Journal Name:
- Aperture Neuro
- Volume:
- 4
- ISSN:
- 2957-3963
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Background: The progressive cognitive decline, an integral component of Alzheimer’s disease (AD), unfolds in tandem with the natural aging process. Neuroimaging features have demonstrated the capacity to distinguish cognitive decline changes stemming from typical brain aging and AD between different chronological points. Objective: To disentangle the normal aging effect from the AD-related accelerated cognitive decline and unravel its genetic components using a neuroimaging-based deep learning approach. Methods: We developed a deep-learning framework based on a dual-loss Siamese ResNet network to extract fine-grained information from the longitudinal structural magnetic resonance imaging (MRI) data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) study. We then conducted genome-wide association studies (GWAS) and post-GWAS analyses to reveal the genetic basis of AD-related accelerated cognitive decline. Results: We used our model to process data from 1,313 individuals, training it on 414 cognitively normal people and predicting cognitive assessment for all participants. In our analysis of accelerated cognitive decline GWAS, we identified two genome-wide significant loci: APOE locus (chromosome 19 p13.32) and rs144614292 (chromosome 11 p15.1). Variant rs144614292 (G > T) has not been reported in previous AD GWA studies. It is within the intronic region of NELL1, which is expressed in neurons and plays a role in controlling cell growth and differentiation. The cell-type-specific enrichment analysis and functional enrichment of GWAS signals highlighted the microglia and immune-response pathways. Conclusions: Our deep learning model effectively extracted relevant neuroimaging features and predicted individual cognitive decline. We reported a novel variant (rs144614292) within the NELL1 gene.more » « less
-
Abstract From birth to 5 years of age, brain structure matures and evolves alongside emerging cognitive and behavioral abilities. In relating concurrent cognitive functioning and measures of brain structure, a major challenge that has impeded prior investigation of their time‐dynamic relationships is the sparse and irregular nature of most longitudinal neuroimaging data. We demonstrate how this problem can be addressed by applying functional concurrent regression models (FCRMs) to longitudinal cognitive and neuroimaging data. The application of FCRM in neuroimaging is illustrated with longitudinal neuroimaging and cognitive data acquired from a large cohort (n= 210) of healthy children, 2–48 months of age. Quantifying white matter myelination by using myelin water fraction (MWF) as imaging metric derived from MRI scans, application of this methodology reveals an early period (200–500 days) during which whole brain and regional white matter structure, as quantified by MWF, is positively associated with cognitive ability, while we found no such association for whole brain white matter volume. Adjusting for baseline covariates including socioeconomic status as measured by maternal education (SES‐ME), infant feeding practice, gender, and birth weight further reveals an increasing association between SES‐ME and cognitive development with child age. These results shed new light on the emerging patterns of brain and cognitive development, indicating that FCRM provides a useful tool for investigating these evolving relationships.more » « less
-
While one can characterize mental health using questionnaires, such tools do not provide direct insight into the underlying biology. By linking approaches that visualize brain activity to questionnaires in the context of individualized prediction, we can gain new insights into the biology and behavioral aspects of brain health. Resting-state fMRI (rs-fMRI) can be used to identify biomarkers of these conditions and study patterns of abnormal connectivity. In this work, we estimate mental health quality for individual participants using static functional network connectivity (sFNC) data from rs-fMRI. The deep learning model uses the sFNC data as input to predict four categories of mental health quality and visualize the neural patterns indicative of each group. We used guided gradient class activation maps (guided Grad-CAM) to identify the most discriminative sFNC patterns. The effectiveness of this model was validated using the UK Biobank dataset, in which we showed that our approach outperformed four alternative models by 4-18% accuracy. The proposed model’s performance evaluation yielded a classification accuracy of 76%, 78%, 88%, and 98% for the excellent, good, fair, and poor mental health categories, with poor mental health accuracy being the highest. The findings show distinct sFNC patterns across each group. The patterns associated with excellent mental health consist of the cerebellar-subcortical regions, whereas the most prominent areas in the poor mental health category are in the sensorimotor and visual domains. Thus the combination of rs-fMRI and deep learning opens a promising path for developing a comprehensive framework to evaluate and measure mental health. Moreover, this approach had the potential to guide the development of personalized interventions and enable the monitoring of treatment response. Overall this highlights the crucial role of advanced imaging modalities and deep learning algorithms in advancing our understanding and management of mental health.more » « less
-
Abstract In neuroimaging research, understanding the intricate dynamics of brain networks over time is paramount for unraveling the complexities of brain function. One approach commonly used to explore the dynamic nature of brain networks is functional connectivity analysis. However, while functional connectivity offers valuable insights, it fails to consider the diverse timescales of coupling between different brain regions. This gap in understanding leaves a significant aspect of brain dynamics unexplored in neuroimaging research. We propose an innovative approach that delves into the dynamic coupling/connectivity timescales of brain regions relative to one another, focusing on how brain region couplings stretch or shrink over time, rather than relying solely on functional connectivity measures. Our method introduces a novel metric called “warping elasticity,” which utilizes dynamic time warping (DTW) to capture the temporal nuances of connectivity. Unlike traditional methods, our approach allows for (potentially nonlinear) dynamic compression and expansion of the time series, offering a more intricate understanding of how coupling between brain regions evolves. Through the adaptive windows employed by the DTW method, we can effectively capture transient couplings within varying connectivity timescales of brain network pairs. In extensive evaluations, our method exhibits high replicability across subjects and diverse datasets, showcasing robustness against noise. More importantly, it uncovers statistically significant distinctions between healthy control (HC) and schizophrenia (SZ) groups through the identification of warp elasticity states. These states are cluster centroids, representing the warp elasticity across subjects and time, offering a novel perspective on the dynamic nature of brain connectivity, distinct from conventional metrics focused solely on functional connectivity. For instance, controls spend more time in a warp elasticity state characterized by timescale stretching of the visual domain relative to other domains, suggesting disruptions in the visual cortex. Conversely, patients show increased time spent in a warp elasticity state with stretching timescales in higher cognitive areas relative to sensory regions, indicative of prolonged cognitive processing of sensory input. Overall, our approach presents a promising avenue for investigating the temporal dynamics of brain network interactions in functional magnetic resonance imaging (fMRI) data. By focusing on the elasticity of connectivity timescales, rather than adhering to functional connectivity metrics, we pave the way for a deeper understanding of neuropsychiatric disorders in neuroscience research.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.52294/001c.118576
