An official website of the United States government
Brain large-scale dynamics is constrained by the heterogeneity of intrinsic anatomical substrate. Little is known how the spatiotemporal dynamics adapt for the heterogeneous structural connectivity (SC). Modern neuroimaging modalities make it possible to study the intrinsic brain activity at the scale of seconds to minutes. Diffusion magnetic resonance imaging (dMRI) and functional MRI reveals the large-scale SC across different brain regions. Electrophysiological methods (i.e. MEG/EEG) provide direct measures of neural activity and exhibits complex neurobiological temporal dynamics which could not be solved by fMRI. However, most of existing multimodal analytical methods collapse the brain measurements either in space or time domain and fail to capture the spatio-temporal circuit dynamics. In this paper, we propose a novel spatio-temporal graph Transformer model to integrate the structural and functional connectivity in both spatial and temporal domain. The proposed method learns the heterogeneous node and graph representation via contrastive learning and multi-head attention based graph Transformer using multimodal brain data (i.e. fMRI, MRI, MEG and behavior performance). The proposed contrastive graph Transformer representation model incorporates the heterogeneity map constrained by T1-to-T2-weighted (T1w/T2w) to improve the model fit to structurefunction interactions. The experimental results with multimodal resting state brain measurements demonstrate the proposed method could highlight the local properties of large-scale brain spatio-temporal dynamics and capture the dependence strength between functional connectivity and behaviors. In summary, the proposed method enables the complex brain dynamics explanation for different modal variants.
more »
« less
A spatially constrained independent component analysis jointly informed by structural and functional network connectivity
Abstract There are a growing number of neuroimaging studies motivating joint structural and functional brain connectivity. Brain connectivity of different modalities provides insight into brain functional organization by leveraging complementary information, especially for brain disorders such as schizophrenia. In this paper, we propose a multi-modal independent component analysis (ICA) model that utilizes information from both structural and functional brain connectivity guided by spatial maps to estimate intrinsic connectivity networks (ICNs). Structural connectivity is estimated through whole-brain tractography on diffusion-weighted MRI (dMRI), while functional connectivity is derived from resting-state functional MRI (rs-fMRI). The proposed structural-functional connectivity and spatially constrained ICA (sfCICA) model estimates ICNs at the subject level using a multi-objective optimization framework. We evaluated our model using synthetic and real datasets (including dMRI and rs-fMRI from 149 schizophrenia patients and 162 controls). Multi-modal ICNs revealed enhanced functional coupling between ICNs with higher structural connectivity, improved modularity, and network distinction, particularly in schizophrenia. Statistical analysis of group differences showed more significant differences in the proposed model compared to the unimodal model. In summary, the sfCICA model showed benefits from being jointly informed by structural and functional connectivity. These findings suggest advantages in simultaneously learning effectively and enhancing connectivity estimates using structural connectivity.
more »
« less
- PAR ID:
- 10515407
- Publisher / Repository:
- DOI PREFIX: 10.1162
- Date Published:
- Journal Name:
- Network Neuroscience
- ISSN:
- 2472-1751
- Format(s):
- Medium: X Size: p. 1-76
- Size(s):
- p. 1-76
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract In this work, we focus on explicitly nonlinear relationships in functional networks. We introduce a technique using normalized mutual information (NMI) that calculates the nonlinear relationship between different brain regions. We demonstrate our proposed approach using simulated data and then apply it to a dataset previously studied by Damaraju et al. This resting‐state fMRI data included 151 schizophrenia patients and 163 age‐ and gender‐matched healthy controls. We first decomposed these data using group independent component analysis (ICA) and yielded 47 functionally relevant intrinsic connectivity networks. Our analysis showed a modularized nonlinear relationship among brain functional networks that was particularly noticeable in the sensory and visual cortex. Interestingly, the modularity appears both meaningful and distinct from that revealed by the linear approach. Group analysis identified significant differences in explicitly nonlinear functional network connectivity (FNC) between schizophrenia patients and healthy controls, particularly in the visual cortex, with controls showing more nonlinearity (i.e., higher normalized mutual information between time courses with linear relationships removed) in most cases. Certain domains, including subcortical and auditory, showed relatively less nonlinear FNC (i.e., lower normalized mutual information), whereas links between the visual and other domains showed evidence of substantial nonlinear and modular properties. Overall, these results suggest that quantifying nonlinear dependencies of functional connectivity may provide a complementary and potentially important tool for studying brain function by exposing relevant variation that is typically ignored. Beyond this, we propose a method that captures both linear and nonlinear effects in a “boosted” approach. This method increases the sensitivity to group differences compared to the standard linear approach, at the cost of being unable to separate linear and nonlinear effects.more » « less
-
Large‐scale analysis of functional connectivity within intrinsic brain networks using functional magnetic resonance imaging (fMRI) data has been widely used for identifying biomarkers in various psychiatric disorders. While the emerging access to large neuroimaging datasets provides unprecedented opportunities for exploring brain functions, they also pose significant computational complexity challenges due to the large amount of inherent variability across individuals and the complexity of brain activity patterns. To address these challenges, this paper introduces two novel constrained ICA methods, arc‐EBM and minc‐EBM, designed to overcome the computational complexity issue by incorporating prior information into the analysis framework. The proposed methods preserve the subject variability by adaptively selecting the constrained parameters for different functional networks and individuals, while also allowing estimation flexibility for activities not covered by the prior information through the concept of free components. Our methods are shown to enhance the precision of functional network estimation and improve the capture of subject variability across different cohorts. We evaluate the proposed methods using both synthetic and real fMRI data. By applying the proposed methods to a resting‐state fMRI dataset including 179 subjects, both algorithms successfully reveal significant group differences in functional network connectivity between healthy controls and schizophrenia patients. The observed group differences, particularly the abnormal connectivity alterations in networks involving the thalamus, subthalamus/hypothalamus, and superior temporal gyrus, align with findings from previous clinical studies. Furthermore, our results demonstrate that the constraint parameters adaptively selected by arc‐EBM reveal more diverse resting‐state network structures in individuals with schizophrenia compared with healthy controls. This finding is consistent with prior studies and suggests that the selected constraint parameters could serve as potential biomarkers for mental disorder diagnosis.more » « less
-
Abstract In this article, we focus on estimating the joint relationship between structural magnetic resonance imaging (sMRI) gray matter (GM), and multiple functional MRI (fMRI) intrinsic connectivity networks (ICNs). To achieve this, we propose a multilink joint independent component analysis (ml‐jICA) method using the same core algorithm as jICA. To relax the jICA assumption, we propose another extension called parallel multilink jICA (pml‐jICA) that allows for a more balanced weight distribution over ml‐jICA/jICA. We assume a shared mixing matrix for both the sMRI and fMRI modalities, while allowing for different mixing matrices linking the sMRI data to the different ICNs. We introduce the model and then apply this approach to study the differences in resting fMRI and sMRI data from patients with Alzheimer's disease (AD) versus controls. The results of the pml‐jICA yield significant differences with large effect sizes that include regions in overlapping portions of default mode network, and also hippocampus and thalamus. Importantly, we identify two joint components with partially overlapping regions which show opposite effects for AD versus controls, but were able to be separated due to being linked to distinct functional and structural patterns. This highlights the unique strength of our approach and multimodal fusion approaches generally in revealing potentially biomarkers of brain disorders that would likely be missed by a unimodal approach. These results represent the first work linking multiple fMRI ICNs to GM components within a multimodal data fusion model and challenges the typical view that brain structure is more sensitive to AD than fMRI.more » « less
-
IntroductionResting-state functional magnetic resonance imaging (rs-fMRI) is a powerful tool for assessing functional brain connectivity. Recent studies have focused on shorter-term connectivity and dynamics in the resting state. However, most of the prior work evaluates changes in time-series correlations. In this study, we propose a framework that focuses on time-resolved spectral coupling (assessed via the correlation between power spectra of the windowed time courses) among different brain circuits determined via independent component analysis (ICA). MethodsMotivated by earlier work suggesting significant spectral differences in people with schizophrenia, we developed an approach to evaluate time-resolved spectral coupling (trSC). To do this, we first calculated the correlation between the power spectra of windowed time-courses pairs of brain components. Then, we subgrouped each correlation map into four subgroups based on the connectivity strength utilizing quartiles and clustering techniques. Lastly, we examined clinical group differences by regression analysis for each averaged count and average cluster size matrices in each quartile. We evaluated the method by applying it to resting-state data collected from 151 (114 males, 37 females) people with schizophrenia (SZ) and 163 (117 males, 46 females) healthy controls (HC). ResultsOur proposed approach enables us to observe the change of connectivity strength within each quartile for different subgroups. People with schizophrenia showed highly modularized and significant differences in multiple network domains, whereas males and females showed less modular differences. Both cell count and average cluster size analysis for subgroups indicate a higher connectivity rate in the fourth quartile for the visual network in the control group. This indicates increased trSC in visual networks in the controls. In other words, this shows that the visual networks in people with schizophrenia have less mutually consistent spectra. It is also the case that the visual networks are less spectrally correlated on short timescales with networks of all other functional domains. ConclusionsThe results of this study reveal significant differences in the degree to which spectral power profiles are coupled over time. Importantly, there are significant but distinct differences both between males and females and between people with schizophrenia and controls. We observed a more significant coupling rate in the visual network for the healthy controls and males in the upper quartile. Fluctuations over time are complex, and focusing on only time-resolved coupling among time-courses is likely to miss important information. Also, people with schizophrenia are known to have impairments in visual processing but the underlying reasons for the impairment are still unknown. Therefore, the trSC approach can be a useful tool to explore the reasons for the impairments.more » « less
