skip to main content

Title: Motion Extraction of the Right Ventricle from 4D Cardiac Cine MRI Using A Deep Learning-Based Deformable Registration Framework
Cardiac Cine Magnetic Resonance (CMR) Imaging has made a significant paradigm shift in medical imaging technology, thanks to its capability of acquiring high spatial and temporal resolution images of different structures within the heart that can be used for reconstructing patient-specific ventricular computational models. In this work, we describe the development of dynamic patient-specific right ventricle (RV) models associated with normal subjects and abnormal RV patients to be subsequently used to assess RV function based on motion and kinematic analysis. We first constructed static RV models using segmentation masks of cardiac chambers generated from our accurate, memory-efficient deep neural architecture - CondenseUNet - featuring both a learned group structure and a regularized weight-pruner to estimate the motion of the right ventricle. In our study, we use a deep learning-based deformable network that takes 3D input volumes and outputs a motion field which is then used to generate isosurface meshes of the cardiac geometry at all cardiac frames by propagating the end-diastole (ED) isosurface mesh using the reconstructed motion field. The proposed model was trained and tested on the Automated Cardiac Diagnosis Challenge (ACDC) dataset featuring 150 cine cardiac MRI patient datasets. The isosurface meshes generated using the proposed pipeline were more » compared to those obtained using motion propagation via traditional non-rigid registration based on several performance metrics, including Dice score and mean absolute distance (MAD). « less
; ; ; ; ; ;
Award ID(s):
1808553 1717894
Publication Date:
Journal Name:
Proc. of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (EMBC 2021)
Page Range or eLocation-ID:
3795 to 3799
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Computational fluid dynamics (CFD) modeling of left ventricle (LV) flow combined with patient medical imaging data has shown great potential in obtaining patient-specific hemodynamics information for functional assessment of the heart. A typical model construction pipeline usually starts with segmentation of the LV by manual delineation followed by mesh generation and registration techniques using separate software tools. However, such approaches usually require significant time and human efforts in the model generation process, limiting large-scale analysis. In this study, we propose an approach toward fully automating the model generation process for CFD simulation of LV flow to significantly reduce LV CFD model generation time. Our modeling framework leverages a novel combination of techniques including deep-learning based segmentation, geometry processing, and image registration to reliably reconstruct CFD-suitable LV models with little-to-no user intervention.1 We utilized an ensemble of two-dimensional (2D) convolutional neural networks (CNNs) for automatic segmentation of cardiac structures from three-dimensional (3D) patient images and our segmentation approach outperformed recent state-of-the-art segmentation techniques when evaluated on benchmark data containing both magnetic resonance (MR) and computed tomography(CT) cardiac scans. We demonstrate that through a combination of segmentation and geometry processing, we were able to robustly create CFD-suitable LV meshes from segmentationsmore »for 78 out of 80 test cases. Although the focus on this study is on image-to-mesh generation, we demonstrate the feasibility of this framework in supporting LV hemodynamics modeling by performing CFD simulations from two representative time-resolved patient-specific image datasets.« less
  2. Faithful, accurate, and successful cardiac biomechanics and electrophysiological simulations require patient-specific geometric models of the heart. Since the cardiac geometry consists of highly-curved boundaries, the use of high-order meshes with curved elements would ensure that the various curves and features present in the cardiac geometry are well-captured and preserved in the corresponding mesh. Most other existing mesh generation techniques require computer-aided design files to represent the geometric boundary, which are often not available for biomedical applications. Unlike such methods, our technique takes a high-order surface mesh, generated from patient medical images, as input and generates a high-order volume mesh directly from the curved surface mesh. In this paper, we use our direct high-order curvilinear tetrahedral mesh generation method [1] to generate several second-order cardiac meshes. Our meshes include the left ventricle myocardia of a healthy heart and hearts with dilated and hypertrophic cardiomyopathy. We show that our high-order cardiac meshes do not contain inverted elements and are of sufficiently high quality for use in cardiac finite element simulations.
  3. Cardiac interventional procedures are often performed under fluoroscopic guidance, exposing both the patient and operators to ionizing radiation. To reduce this risk of radiation exposure, we are exploring the use of photoacoustic imaging paired with robotic visual servoing for cardiac catheter visualization and surgical guidance. A cardiac catheterization procedure was performed on two in vivo swine after inserting an optical fiber into the cardiac catheter to produce photoacoustic signals from the tip of the fiber-catheter pair. A combination of photoacoustic imaging and robotic visual servoing was employed to visualize and maintain constant sight of the catheter tip in order to guide the catheter through the femoral or jugular vein, toward the heart. Fluoroscopy provided initial ground truth estimates for 1D validation of the catheter tip positions, and these estimates were refined using a 3D electromagnetic-based cardiac mapping system as the ground truth. The 1D and 3D root mean square errors ranged 0.25-2.28 mm and 1.24-1.54 mm, respectively. The catheter tip was additionally visualized at three locations within the heart: (1) inside the right atrium, (2) in contact with the right ventricular outflow tract, and (3) inside the right ventricle. Lasered regions of cardiac tissue were resected for histopathological analysis, whichmore »revealed no laser-related tissue damage, despite the use of 2.98 mJ per pulse at the fiber tip (379.2 mJ/cm2 fluence). In addition, there was a 19 dB difference in photoacoustic signal contrast when visualizing the catheter tip pre-and post-endocardial tissue contact, which is promising for contact confirmation during cardiac interventional procedures (e.g., cardiac radiofrequency ablation). These results are additionally promising for the use of photoacoustic imaging to guide cardiac interventions by providing depth information and enhanced visualization of catheter tip locations within blood vessels and within the beating heart.« less
  4. This paper introduces a deep neural network based method, i.e., DeepOrganNet, to generate and visualize fully high-fidelity 3D / 4D organ geometric models from single-view medical images with complicated background in real time. Traditional 3D / 4D medical image reconstruction requires near hundreds of projections, which cost insufferable computational time and deliver undesirable high imaging / radiation dose to human subjects. Moreover, it always needs further notorious processes to segment or extract the accurate 3D organ models subsequently. The computational time and imaging dose can be reduced by decreasing the number of projections, but the reconstructed image quality is degraded accordingly. To our knowledge, there is no method directly and explicitly reconstructing multiple 3D organ meshes from a single 2D medical grayscale image on the fly. Given single-view 2D medical images, e.g., 3D / 4D-CT projections or X-ray images, our end-to-end DeepOrganNet framework can efficiently and effectively reconstruct 3D / 4D lung models with a variety of geometric shapes by learning the smooth deformation fields from multiple templates based on a trivariate tensor-product deformation technique, leveraging an informative latent descriptor extracted from input 2D images. The proposed method can guarantee to generate high-quality and high-fidelity manifold meshes for 3D /more »4D lung models; while, all current deep learning based approaches on the shape reconstruction from a single image cannot. The major contributions of this work are to accurately reconstruct the 3D organ shapes from 2D single-view projection, significantly improve the procedure time to allow on-the-fly visualization, and dramatically reduce the imaging dose for human subjects. Experimental results are evaluated and compared with the traditional reconstruction method and the state-of-the-art in deep learning, by using extensive 3D and 4D examples, including both synthetic phantom and real patient datasets. The efficiency of the proposed method shows that it only needs several milliseconds to generate organ meshes with 10K vertices, which has great potential to be used in real-time image guided radiation therapy (IGRT).« less
  5. Cigarette smoking is the single most important risk factor for the development of cardiovascular and pulmonary diseases; however, the role of nicotine in the pathogenesis of these diseases is incompletely understood. The purpose of this study was to examine the effects of chronic nicotine inhalation on the development of cardiovascular and pulmonary disease with a focus on blood pressure and cardiac remodeling. Male C57BL6/J mice were exposed to air (control) or nicotine vapor (daily, 12 hour on/12 hour off) for 8 weeks. Systemic blood pressure was recorded weekly by radio-telemetry, and cardiac remodeling was monitored by echocardiography. At the end of the 8 weeks, mice were subjected to right heart catheterization to measure right ventricular systolic pressure. Nicotine-exposed mice exhibited elevated systemic blood pressure from weeks 1 to 3, which then returned to baseline from weeks 4 to 8, indicating development of tolerance to nicotine. At 8 weeks, significantly increased right ventricular systolic pressure was detected in nicotine-exposed mice compared with the air controls. Echocardiography showed that 8-week nicotine inhalation resulted in right ventricular (RV) hypertrophy with increased RV free wall thickness and a trend of increase in RV internal diameter. In contrast, there were no significant structural or functionalmore »changes in the left ventricle following nicotine exposure. Mechanistically, we observed increased expression of angiotensin-converting enzyme and enhanced activation of mitogen-activated protein kinase pathways in the RV but not in the left ventricle. We conclude that chronic nicotine inhalation alters both systemic and pulmonary blood pressure with the latter accompanied by RV remodeling, possibly leading to progressive and persistent pulmonary hypertension.« less