skip to main content

Explore Research Products in the NSF-PAR

Title: NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registration
Deformable image registration (DIR), aiming to find spatial correspondence between images, is one of the most critical problems in the domain of medical image analysis. In this paper, we present a novel, generic, and accurate diffeomorphic image registration framework that utilizes neural ordinary differential equations (NODEs). We model each voxel as a moving particle and consider the set of all voxels in a 3D image as a high-dimensional dynamical system whose trajectory determines the targeted deformation field. Our method leverages deep neural networks for their expressive power in modeling dynamical systems, and simultaneously optimizes for a dynamical system between the image pairs and the corresponding transformation. Our formulation allows various constraints to be imposed along the transformation to maintain desired regularities. Our experiment results show that our method outperforms the benchmarks under various metrics. Additionally, we demonstrate the feasibility to expand our framework to register multiple image sets using a unified form of transformation, which could possibly serve a wider range of applications.  more » « less
Award ID(s):
1910308
NSF-PAR ID:
10345736
Author(s) / Creator(s):
Date Published:
Journal Name:
IEEE/CVF Conference on Computer Vision and Pattern Recognition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ( , Magnetic Resonance in Medicine)
    Purpose

    The ability to register image data to a common coordinate system is a critical feature of virtually all imaging studies. However, in spite of the abundance of literature on the subject and the existence of several variants of registration algorithms, their practical utility remains problematic, as commonly acknowledged even by developers of these methods.

     Methods

    A new registration method is presented that utilizes a Hamiltonian formalism and constructs registration as a sequence of symplectomorphic maps in conjunction with a novel phase space regularization. For validation of the framework a panel of deformations expressed in analytical form is developed that includes deformations based on known physical processes in MRI and reproduces various distortions and artifacts typically present in images collected using these different MRI modalities.

     Results

    The method is demonstrated on the three different magnetic resonance imaging (MRI) modalities by mapping between high resolution anatomical (HRA) volumes, medium resolution diffusion weighted MRI (DW‐MRI) and HRA volumes, and low resolution functional MRI (fMRI) and HRA volumes.

     Conclusions

    The method has shown an excellent performance and the panel of deformations was instrumental to quantify its repeatability and reproducibility in comparison to several available alternative approaches.

     
    more » « less
  2. ; ; ( , Journal of Manufacturing Science and Engineering)
    Abstract

    Automated optical inspection (AOI) is increasingly advocated for in situ quality monitoring of additive manufacturing (AM) processes. The availability of layerwise imaging data improves the information visibility during fabrication processes and is thus conducive to performing online certification. However, few, if any, have investigated the high-speed contact image sensors (CIS) (i.e., originally developed for document scanners and multifunction printers) for AM quality monitoring. In addition, layerwise images show complex patterns and often contain hidden information that cannot be revealed in a single scale. A new and alternative approach will be to analyze these intrinsic patterns with multiscale lenses. Therefore, the objective of this article is to design and develop an AOI system with contact image sensors for multiresolution quality inspection of layerwise builds in additive manufacturing. First, we retrofit the AOI system with contact image sensors in industrially relevant 95 mm/s scanning speed to a laser-powder-bed-fusion (LPBF) machines. Then, we design the experiments to fabricate nine parts under a variety of factor levels (e.g., gas flow blockage, re-coater damage, laser power changes). In each layer, the AOI system collects imaging data of both recoating powder beds before the laser fusion and surface finishes after the laser fusion. Second, layerwise images are pre-preprocessed for alignment, registration, and identification of regions of interests (ROIs) of these nine parts. Then, we leverage the wavelet transformation to analyze ROI images in multiple scales and further extract salient features that are sensitive to process variations, instead of extraneous noises. Third, we perform the paired comparison analysis to investigate how different levels of factors influence the distribution of wavelet features. Finally, these features are shown to be effective in predicting the extent of defects in the computed tomography (CT) data of layerwise AM builds. The proposed framework of multiresolution quality inspection is evaluated and validated using real-world AM imaging data. Experimental results demonstrated the effectiveness of the proposed AOI system with contact image sensors for online quality inspection of layerwise builds in AM processes.

     
    more » « less
  3. ; ; ( , Methods in Ecology and Evolution)
    Abstract

    Landmark‐based geometric morphometrics has emerged as an essential discipline for the quantitative analysis of size and shape in ecology and evolution. With the ever‐increasing density of digitized landmarks, the possible development of a fully automated method of landmark placement has attracted considerable attention. Despite the recent progress in image registration techniques, which could provide a pathway to automation, three‐dimensional (3D) morphometric data are still mainly gathered by trained experts. For the most part, the large infrastructure requirements necessary to perform image‐based registration, together with its system specificity and its overall speed, have prevented its wide dissemination.

    Here, we propose and implement a general and lightweight point cloud‐based approach to automatically collect high‐dimensional landmark data in 3D surfaces (Automated Landmarking through Point cloud Alignment and Correspondence Analysis). Our framework possesses several advantages compared with image‐based approaches. First, it presents comparable landmarking accuracy, despite relying on a single, random reference specimen and much sparser sampling of the structure's surface. Second, it can be efficiently run on consumer‐grade personal computers. Finally, it is general and can be applied at the intraspecific level to any biological structure of interest, regardless of whether anatomical atlases are available.

    Our validation procedures indicate that the method can recover intraspecific patterns of morphological variation that are largely comparable to those obtained by manual digitization, indicating that the use of an automated landmarking approach should not result in different conclusions regarding the nature of multivariate patterns of morphological variation.

    The proposed point cloud‐based approach has the potential to increase the scale and reproducibility of morphometrics research. To allow ALPACA to be used out‐of‐the‐box by users with no prior programming experience, we implemented it as a SlicerMorph module. SlicerMorph is an extension that enables geometric morphometrics data collection and 3D specimen analysis within the open‐source 3D Slicer biomedical visualization ecosystem. We expect that convenient access to this platform will make ALPACA broadly applicable within ecology and evolution.

     
    more » « less
  4. ; ; ; ; ( , arXivorg)
    Forward invariance is a long-studied property in control theory that is used to certify that a dynamical system stays within some pre-specified set of states for all time, and also admits robustness guarantees (e.g., the certificate holds under perturbations). We propose a general framework for training and provably certifying robust forward invariance in Neural ODEs. We apply this framework in two settings: certified adversarial robustness for image classification, and certified safety in continuous control. Notably, our method empirically produces superior adversarial robustness guarantees compared to prior work on certifiably robust Neural ODEs (including implicit-depth models). 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al ( , Journal of Biophotonics)

    Convolutional neural networks (CNNs) are powerful tools for image segmentation and classification. Here, we use this method to identify and mark the heart region ofDrosophilaat different developmental stages in the cross‐sectional images acquired by a custom optical coherence microscopy (OCM) system. With our well‐trained CNN model, the heart regions through multiple heartbeat cycles can be marked with an intersection over union of ~86%. Various morphological and dynamical cardiac parameters can be quantified accurately with automatically segmented heart regions. This study demonstrates an efficient heart segmentation method to analyze OCM images of the beating heart inDrosophila.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email