skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Deep learning microstructure estimation of developing brains from diffusion MRI: A newborn and fetal study
Diffusion-weighted magnetic resonance imaging (dMRI) is widely used to assess the brain white matter. Fiber orientation distribution functions (FODs) are a common way of representing the orientation and density of white matter fibers. However, with standard FOD computation methods, accurate estimation requires a large number of measurements that usually cannot be acquired for newborns and fetuses. We propose to overcome this limitation by using a deep learning method to map as few as six diffusion-weighted measurements to the target FOD. To train the model, we use the FODs computed using multi-shell high angular resolution measurements as target. Extensive quantitative evaluations show that the new deep learning method, using significantly fewer measurements, achieves comparable or superior results than standard methods such as Constrained Spherical Deconvolution and two state-of-the-art deep learning methods. For voxels with one and two fibers, respectively, our method shows an agreement rate in terms of the number of fibers of 77.5% and 22.2%, which is 3% and 5.4% higher than other deep learning methods, and an angular error of 10° and 20°, which is 6° and 5° lower than other deep learning methods. To determine baselines for assessing the performance of our method, we compute agreement metrics using densely sampled newborn data. Moreover, we demonstrate the generalizability of the new deep learning method across scanners, acquisition protocols, and anatomy on two clinical external datasets of newborns and fetuses. We validate fetal FODs, successfully estimated for the first time with deep learning, using post-mortem histological data. Our results show the advantage of deep learning in computing the fiber orientation density for the developing brain from in-vivo dMRI measurements that are often very limited due to constrained acquisition times. Our findings also highlight the intrinsic limitations of dMRI for probing the developing brain microstructure.  more » « less
Award ID(s):
2123061
PAR ID:
10509461
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
ScienceDirect
Date Published:
Journal Name:
Medical Image Analysis
Volume:
95
Issue:
C
ISSN:
1361-8415
Page Range / eLocation ID:
103186
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Human Connectome Project (HCP) has become a keystone dataset in human neuroscience, with a plethora of important applications in advancing brain imaging methods and an understanding of the human brain. We focused on tractometry of HCP diffusion-weighted MRI (dMRI) data. We used an open-source software library (pyAFQ;https://yeatmanlab.github.io/pyAFQ) to perform probabilistic tractography and delineate the major white matter pathways in the HCP subjects that have a complete dMRI acquisition (n = 1,041). We used diffusion kurtosis imaging (DKI) to model white matter microstructure in each voxel of the white matter, and extracted tract profiles of DKI-derived tissue properties along the length of the tracts. We explored the empirical properties of the data: first, we assessed the heritability of DKI tissue properties using the known genetic linkage of the large number of twin pairs sampled in HCP. Second, we tested the ability of tractometry to serve as the basis for predictive models of individual characteristics (e.g., age, crystallized/fluid intelligence, reading ability, etc.), compared to local connectome features. To facilitate the exploration of the dataset we created a new web-based visualization tool and use this tool to visualize the data in the HCP tractometry dataset. Finally, we used the HCP dataset as a test-bed for a new technological innovation: the TRX file-format for representation of dMRI-based streamlines. We released the processing outputs and tract profiles as a publicly available data resource through the AWS Open Data program's Open Neurodata repository. We found heritability as high as 0.9 for DKI-based metrics in some brain pathways. We also found that tractometry extracts as much useful information about individual differences as the local connectome method. We released a new web-based visualization tool for tractometry --- “Tractoscope” (https://nrdg.github.io/tractoscope). We found that the TRX files require considerably less disk space - a crucial attribute for large datasets like HCP. In addition, TRX incorporates a specification for grouping streamlines, further simplifying tractometry analysis. 
    more » « less
  2. We use a multidimensional signal representation that inte- grates diffusion Magnetic Resonance Imaging (dMRI) and tractography (brain connections) using sparse tensor decomposition. The representa- tion encodes brain connections (fibers) into a very-large, but sparse, core tensor and allows to predict dMRI measurements based on a dictionary of diffusion signals. We propose an algorithm to learn the constituent parts of the model from a dataset. The algorithm assumes a tractography model (support of core tensor) and iteratively minimizes the Frobenius norm of the error as a function of the dictionary atoms, the values of nonzero entries in the sparse core tensor and the fiber weights. We use a nonparametric dictionary learning (DL) approach to estimate signal atoms. Moreover, the algorithm is able to learn multiple dictionaries associated to different brain locations (voxels) allowing for mapping distinctive tissue types. We illustrate the algorithm through results obtained on a large in-vivo high-resolution dataset. 
    more » « less
  3. Abstract We describe a dataset of processed data with associated reproducible preprocessing pipeline collected from two collegiate athlete groups and one non-athlete group. The dataset shares minimally processed diffusion-weighted magnetic resonance imaging (dMRI) data, three models of the diffusion signal in the voxel, full-brain tractograms, segmentation of the major white matter tracts as well as structural connectivity matrices. There is currently a paucity of similar datasets openly shared. Furthermore, major challenges are associated with collecting this type of data. The data and derivatives shared here can be used as a reference to study the effects of long-term exposure to collegiate athletics, such as the effects of repetitive head impacts. We use advanced anatomical and dMRI data processing methods publicly available as reproducible web services at brainlife.io. 
    more » « less
  4. Brain large-scale dynamics is constrained by the heterogeneity of intrinsic anatomical substrate. Little is known how the spatiotemporal dynamics adapt for the heterogeneous structural connectivity (SC). Modern neuroimaging modalities make it possible to study the intrinsic brain activity at the scale of seconds to minutes. Diffusion magnetic resonance imaging (dMRI) and functional MRI reveals the large-scale SC across different brain regions. Electrophysiological methods (i.e. MEG/EEG) provide direct measures of neural activity and exhibits complex neurobiological temporal dynamics which could not be solved by fMRI. However, most of existing multimodal analytical methods collapse the brain measurements either in space or time domain and fail to capture the spatio-temporal circuit dynamics. In this paper, we propose a novel spatio-temporal graph Transformer model to integrate the structural and functional connectivity in both spatial and temporal domain. The proposed method learns the heterogeneous node and graph representation via contrastive learning and multi-head attention based graph Transformer using multimodal brain data (i.e. fMRI, MRI, MEG and behavior performance). The proposed contrastive graph Transformer representation model incorporates the heterogeneity map constrained by T1-to-T2-weighted (T1w/T2w) to improve the model fit to structurefunction interactions. The experimental results with multimodal resting state brain measurements demonstrate the proposed method could highlight the local properties of large-scale brain spatio-temporal dynamics and capture the dependence strength between functional connectivity and behaviors. In summary, the proposed method enables the complex brain dynamics explanation for different modal variants. 
    more » « less
  5. Integral curve estimation is a well-established method for reconstructing in vivo nerve fiber pathways in thewhite matter of the brain. Using longitudinal high angular resolution diffusion imaging (HARDI) data, weformulate the longitudinal ensemble of fiber trajectories as an integral curve with the parameter time. The goalof this article is to develop a test statistic to determine whether there are anatomically plausible changes innerve fibers with two directions, such as crossing, kissing, or bending fibers. We envision that rejecting thenull hypothesis could help identify a potential anatomical biomarker for neurodegenerative diseases, such asAlzheimer’s disease. 
    more » « less