skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 5:00 PM ET until 11:00 PM ET on Friday, June 21 due to maintenance. We apologize for the inconvenience.

Title: Motion Extraction of the Right Ventricle from 4D Cardiac Cine MRI Using A Deep Learning-Based Deformable Registration Framework
Cardiac Cine Magnetic Resonance (CMR) Imaging has made a significant paradigm shift in medical imaging technology, thanks to its capability of acquiring high spatial and temporal resolution images of different structures within the heart that can be used for reconstructing patient-specific ventricular computational models. In this work, we describe the development of dynamic patient-specific right ventricle (RV) models associated with normal subjects and abnormal RV patients to be subsequently used to assess RV function based on motion and kinematic analysis. We first constructed static RV models using segmentation masks of cardiac chambers generated from our accurate, memory-efficient deep neural architecture - CondenseUNet - featuring both a learned group structure and a regularized weight-pruner to estimate the motion of the right ventricle. In our study, we use a deep learning-based deformable network that takes 3D input volumes and outputs a motion field which is then used to generate isosurface meshes of the cardiac geometry at all cardiac frames by propagating the end-diastole (ED) isosurface mesh using the reconstructed motion field. The proposed model was trained and tested on the Automated Cardiac Diagnosis Challenge (ACDC) dataset featuring 150 cine cardiac MRI patient datasets. The isosurface meshes generated using the proposed pipeline were compared to those obtained using motion propagation via traditional non-rigid registration based on several performance metrics, including Dice score and mean absolute distance (MAD).  more » « less
Award ID(s):
1808553 1717894
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Proc. of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (EMBC 2021)
Page Range / eLocation ID:
3795 to 3799
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Computational fluid dynamics (CFD) modeling of left ventricle (LV) flow combined with patient medical imaging data has shown great potential in obtaining patient-specific hemodynamics information for functional assessment of the heart. A typical model construction pipeline usually starts with segmentation of the LV by manual delineation followed by mesh generation and registration techniques using separate software tools. However, such approaches usually require significant time and human efforts in the model generation process, limiting large-scale analysis. In this study, we propose an approach toward fully automating the model generation process for CFD simulation of LV flow to significantly reduce LV CFD model generation time. Our modeling framework leverages a novel combination of techniques including deep-learning based segmentation, geometry processing, and image registration to reliably reconstruct CFD-suitable LV models with little-to-no user intervention.1 We utilized an ensemble of two-dimensional (2D) convolutional neural networks (CNNs) for automatic segmentation of cardiac structures from three-dimensional (3D) patient images and our segmentation approach outperformed recent state-of-the-art segmentation techniques when evaluated on benchmark data containing both magnetic resonance (MR) and computed tomography(CT) cardiac scans. We demonstrate that through a combination of segmentation and geometry processing, we were able to robustly create CFD-suitable LV meshes from segmentations for 78 out of 80 test cases. Although the focus on this study is on image-to-mesh generation, we demonstrate the feasibility of this framework in supporting LV hemodynamics modeling by performing CFD simulations from two representative time-resolved patient-specific image datasets. 
    more » « less
  2. Abstract

    Right ventricular (RV) failure remains a significant burden for patients with advanced heart failure, especially after major cardiac surgeries such as implantation of left ventricular assist devices. Device solutions that can assist the complex biological function of heart muscle without the disadvantages of bulky designs and infection‐prone drivelines remain an area of pressing clinical need, especially for the right ventricle. In addition, devices that incur contact between blood and artificial surfaces mandate long‐term use of blood‐thinning medications, carrying increased risks for the patients. This work describes the design of a biomimetic, elastic sleeve to support RV‐specific motion via tuned regional mechanical properties. The RV external device (RVEX) in computational models as well as benchtop models and ex vivo (i.e., explanted heart) setups are evaluated to characterize the device and predict functional benefit. Additionally, long‐term implantation potential is demonstrated in mice. Finally, the ability to sensorize the RVEX device to yield resistive self‐sensing capabilities to continuously monitor ventricular deformation, as demonstrated in benchtop experiments and in live animal surgeries, is proposed.

    more » « less
  3. Faithful, accurate, and successful cardiac biomechanics and electrophysiological simulations require patient-specific geometric models of the heart. Since the cardiac geometry consists of highly-curved boundaries, the use of high-order meshes with curved elements would ensure that the various curves and features present in the cardiac geometry are well-captured and preserved in the corresponding mesh. Most other existing mesh generation techniques require computer-aided design files to represent the geometric boundary, which are often not available for biomedical applications. Unlike such methods, our technique takes a high-order surface mesh, generated from patient medical images, as input and generates a high-order volume mesh directly from the curved surface mesh. In this paper, we use our direct high-order curvilinear tetrahedral mesh generation method [1] to generate several second-order cardiac meshes. Our meshes include the left ventricle myocardia of a healthy heart and hearts with dilated and hypertrophic cardiomyopathy. We show that our high-order cardiac meshes do not contain inverted elements and are of sufficiently high quality for use in cardiac finite element simulations. 
    more » « less
  4. Bernard, O. ; Clarysse, P. ; Duchateau, N. ; Ohayon, J. ; Viallon, M (Ed.)
    Increased passive myocardial stiffness is implicated in the pathophysiology of many cardiac diseases, and its in vivo estimation can improve management of heart disease. MRI-driven computational constitutive modeling has been used extensively to evaluate passive myocardial stiffness. This approach requires subject-specific data that is best acquired with different MRI sequences: conventional cine (e.g. bSSFP), tagged MRI (or DENSE), and cardiac diffusion tensor imaging. However, due to the lack of comprehensive datasets and the challenge of incorporating multi-phase and single-phase disparate MRI data, no studies have combined in vivo cine bSSFP, tagged MRI, and cardiac diffusion tensor imaging to estimate passive myocardial stiffness. The objective of this work was to develop a personalized in silico left ventricular model to evaluate passive myocardial stiffness by integrating subject-specific geometric data derived from cine bSSFP, regional kinematics extracted from tagged MRI, and myocardial microstructure measured using in vivo cardiac diffusion tensor imaging. To demonstrate the feasibility of using a complete subject-specific imaging dataset for passive myocardial stiffness estimation, we calibrated a bulk stiffness parameter of a transversely isotropic exponential constitutive relation to match the local kinematic field extracted from tagged MRI. This work establishes a pipeline for developing subject-specific biomechanical ventricular models to probe passive myocardial mechanical behavior, using comprehensive cardiac imaging data from multiple in vivo MRI sequences. 
    more » « less
  5. Puyol Anton, E ; Pop, M ; Sermesant, M ; Campello, V ; Lalande, A ; Lekadir, K ; Suinesiaputra, A ; Camara, O ; Young, A (Ed.)
    Cardiac cine magnetic resonance imaging (CMRI) is the reference standard for assessing cardiac structure as well as function. However, CMRI data presents large variations among different centers, vendors, and patients with various cardiovascular diseases. Since typical deep-learning-based segmentation methods are usually trained using a limited number of ground truth annotations, they may not generalize well to unseen MR images, due to the variations between the training and testing data. In this study, we proposed an approach towards building a generalizable deep-learning-based model for cardiac structure segmentations from multi-vendor,multi-center and multi-diseases CMRI data. We used a novel combination of image augmentation and a consistency loss function to improve model robustness to typical variations in CMRI data. The proposed image augmentation strategy leverages un-labeled data by a) using CycleGAN to generate images in different styles and b) exchanging the low-frequency features of images from different vendors. Our model architecture was based on an attention-gated U-Net model that learns to focus on cardiac structures of varying shapes and sizes while suppressing irrelevant regions. The proposed augmentation and consistency training method demonstrated improved performance on CMRI images from new vendors and centers. When evaluated using CMRI data from 4 vendors and 6 clinical center, our method was generally able to produce accurate segmentations of cardiac structures. 
    more » « less