An official website of the United States government
Abstract Multimodal neuroimaging research plays a pivotal role in understanding the complexities of the human brain and its disorders. Independent component analysis (ICA) has emerged as a widely used and powerful tool for disentangling mixed independent sources, particularly in the analysis of functional magnetic resonance imaging (fMRI) data. This paper extends the use of ICA as a unifying framework for multimodal fusion, introducing a novel approach termed parallel multilink group joint ICA (pmg-jICA). The method allows for the fusion of gray matter maps from structural MRI (sMRI) data to multiple fMRI intrinsic networks, addressing the limitations of previous models. The effectiveness of pmg-jICA is demonstrated through its application to an Alzheimer’s dataset, yielding linked structure-function outputs for 53 brain networks. Our approach leverages the complementary information from various imaging modalities, providing a unique perspective on brain alterations in Alzheimer’s disease. The pmg-jICA identifies several components with significant differences between HC and AD groups including thalamus, caudate, putamen with in the subcortical (SC) domain, insula, parahippocampal gyrus within the cognitive control (CC) domain, and the lingual gyrus within the visual (VS) domain, providing localized insights into the links between AD and specific brain regions. In addition, because we link across multiple brain networks, we can also compute functional network connectivity (FNC) from spatial maps and subject loadings, providing a detailed exploration of the relationships between different brain regions and allowing us to visualize spatial patterns and loading parameters in sMRI along with intrinsic networks and FNC from the fMRI data. In essence, developed approach combines concepts from joint ICA and group ICA to provide a rich set of output characterizing data-driven links between covarying gray matter networks, and a (potentially large number of) resting fMRI networks allowing further study in the context of structure/function links. We demonstrate the utility of the approach by highlighting key structure/function disruptions in Alzheimer’s individuals.
more »
« less
Multimodal fusion of multiple rest fMRI networks and MRI gray matter via parallel multilink joint ICA reveals highly significant function/structure coupling in Alzheimer's disease
Abstract In this article, we focus on estimating the joint relationship between structural magnetic resonance imaging (sMRI) gray matter (GM), and multiple functional MRI (fMRI) intrinsic connectivity networks (ICNs). To achieve this, we propose a multilink joint independent component analysis (ml‐jICA) method using the same core algorithm as jICA. To relax the jICA assumption, we propose another extension called parallel multilink jICA (pml‐jICA) that allows for a more balanced weight distribution over ml‐jICA/jICA. We assume a shared mixing matrix for both the sMRI and fMRI modalities, while allowing for different mixing matrices linking the sMRI data to the different ICNs. We introduce the model and then apply this approach to study the differences in resting fMRI and sMRI data from patients with Alzheimer's disease (AD) versus controls. The results of the pml‐jICA yield significant differences with large effect sizes that include regions in overlapping portions of default mode network, and also hippocampus and thalamus. Importantly, we identify two joint components with partially overlapping regions which show opposite effects for AD versus controls, but were able to be separated due to being linked to distinct functional and structural patterns. This highlights the unique strength of our approach and multimodal fusion approaches generally in revealing potentially biomarkers of brain disorders that would likely be missed by a unimodal approach. These results represent the first work linking multiple fMRI ICNs to GM components within a multimodal data fusion model and challenges the typical view that brain structure is more sensitive to AD than fMRI.
more »
« less
- Award ID(s):
- 2112455
- PAR ID:
- 10467810
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Human Brain Mapping
- Volume:
- 44
- Issue:
- 15
- ISSN:
- 1065-9471
- Format(s):
- Medium: X Size: p. 5167-5179
- Size(s):
- p. 5167-5179
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract There are a growing number of neuroimaging studies motivating joint structural and functional brain connectivity. Brain connectivity of different modalities provides insight into brain functional organization by leveraging complementary information, especially for brain disorders such as schizophrenia. In this paper, we propose a multi-modal independent component analysis (ICA) model that utilizes information from both structural and functional brain connectivity guided by spatial maps to estimate intrinsic connectivity networks (ICNs). Structural connectivity is estimated through whole-brain tractography on diffusion-weighted MRI (dMRI), while functional connectivity is derived from resting-state functional MRI (rs-fMRI). The proposed structural-functional connectivity and spatially constrained ICA (sfCICA) model estimates ICNs at the subject level using a multi-objective optimization framework. We evaluated our model using synthetic and real datasets (including dMRI and rs-fMRI from 149 schizophrenia patients and 162 controls). Multi-modal ICNs revealed enhanced functional coupling between ICNs with higher structural connectivity, improved modularity, and network distinction, particularly in schizophrenia. Statistical analysis of group differences showed more significant differences in the proposed model compared to the unimodal model. In summary, the sfCICA model showed benefits from being jointly informed by structural and functional connectivity. These findings suggest advantages in simultaneously learning effectively and enhancing connectivity estimates using structural connectivity.more » « less
-
Abstract The study of human brain connectivity, including structural connectivity (SC) and functional connectivity (FC), provides insights into the neurophysiological mechanism of brain function and its relationship to human behavior and cognition. Both types of connectivity measurements provide crucial yet complementary information. However, integrating these two modalities into a single framework remains a challenge, because of the differences in their quantitative interdependencies as well as their anatomical representations due to distinctive imaging mechanisms. In this study, we introduced a new method, joint connectivity matrix independent component analysis (cmICA), which provides a data‐driven parcellation and automated‐linking of SC and FC information simultaneously using a joint analysis of functional magnetic resonance imaging (MRI) and diffusion‐weighted MRI data. We showed that these two connectivity modalities produce common cortical segregation, though with various degrees of (dis)similarity. Moreover, we show conjoint FC networks and structural white matter tracts that directly link these cortical parcellations/sources, within one analysis. Overall, data‐driven joint cmICA provides a new approach for integrating or fusing structural connectivity and FC systematically and conveniently, and provides an effective tool for connectivity‐based multimodal data fusion in brain.more » « less
-
Background Schizophrenia is a brain disorder characterized by diffuse, diverse, and wide-spread changes in gray matter volume (GM) and white matter structure (fractional anisotropy, FA), as well as cognitive impairments that greatly impact an individual’s quality of life. While the relationship of each of these image modalities and their links to schizophrenia status and cognitive impairment has been investigated separately, a multimodal fusion via parallel independent component analysis (pICA) affords the opportunity to explore the relationships between the changes in GM and FA, and the implications these network changes have on cognitive performance. Methods Images from 73 subjects with schizophrenia (SZ) and 82 healthy controls (HC) were drawn from an existing dataset. We investigated 12 components from each feature (FA and GM). Loading coefficients from the images were used to identify pairs of features that were significantly correlated and showed significant group differences between HC and SZ. MANCOVA analysis uncovered the relationships the identified spatial maps had with age, gender, and a global cognitive performance score. Results Three component pairs showed significant group differences (HC > SZ) in both gray and white matter measurements. Two of the component pairs identified networks of gray matter that drove significant relationships with cognition (HC > SZ) after accounting for age and gender. The gray and white matter structural networks identified in these three component pairs pull broadly from many regions, including the right and left thalamus, lateral occipital cortex, multiple regions of the middle temporal gyrus, precuneus cortex, postcentral gyrus, cingulate gyrus/cingulum, lingual gyrus, and brain stem. Conclusion The results of this multimodal analysis adds to our understanding of how the relationship between GM, FA, and cognition differs between HC and SZ by highlighting the correlated intermodal covariance of these structural networks and their differential relationships with cognitive performance. Previous unimodal research has found similar areas of GM and FA differences between these groups, and the cognitive deficits associated with SZ have been well documented. This study allowed us to evaluate the intercorrelated covariance of these structural networks and how these networks are involved the differences in cognitive performance between HC and SZ.more » « less
-
Graph theoretical analyses have become standard tools in modeling functional and anatomical connectivity in the brain. With the advent of connectomics, the primary graphs or networks of interest are structural connectome (derived from DTI tractography) and functional connectome (derived from resting-state fMRI). However, most published connectome studies have focused on either structural or functional connectome, yet complementary information between them, when available in the same dataset, can be jointly leveraged to improve our understanding of the brain. To this end, we propose a function-constrained structural graph variational autoencoder (FCS-GVAE) capable of incorporating information from both functional and structural connectome in an unsupervised fashion. This leads to a joint low-dimensional embedding that establishes a unified spatial coordinate system for comparing across different subjects. We evaluate our approach using the publicly available OASIS-3 Alzheimer’s disease (AD) dataset and show that a variational formulation is necessary to optimally encode functional brain dynamics. Further, the proposed joint embedding approach can more accurately distinguish different patient sub-populations than approaches that do not use complementary connectome information.more » « less
