skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Machine Learning and Deep Learning Applications in Magnetic Particle Imaging
In recent years, magnetic particle imaging (MPI) has emerged as a promising imaging technique depicting high sensitivity and spatial resolution. It originated in the early 2000s where it proposed a new approach to challenge the low spatial resolution achieved by using relaxometry in order to measure the magnetic fields. MPI presents 2D and 3D images with high temporal resolution, non‐ionizing radiation, and optimal visual contrast due to its lack of background tissue signal. Traditionally, the images were reconstructed by the conversion of signal from the induced voltage by generating system matrix and X‐space based methods. Because image reconstruction and analyses play an integral role in obtaining precise information from MPI signals, newer artificial intelligence‐based methods are continuously being researched and developed upon. In this work, we summarize and review the significance and employment of machine learning and deep learning models for applications with MPI and the potential they hold for the future. Level of Evidence5 Technical EfficacyStage 1  more » « less
Award ID(s):
1900473
PAR ID:
10566693
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Wiley Periodicals
Date Published:
Journal Name:
Journal of Magnetic Resonance Imaging
Volume:
61
Issue:
1
ISSN:
1053-1807
Page Range / eLocation ID:
42 to 51
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Advanced Healthcare Materials)
    Abstract Rapid and accurate assessment of conditions characterized by altered blood flow, cardiac blood pooling, or internal bleeding is crucial for diagnosing and treating various clinical conditions. While widely used imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound offer unique diagnostic advantages, they fall short for specific indications due to limited penetration depth and prolonged acquisition times. Magnetic particle imaging (MPI), an emerging tracer‐based technique, holds promise for blood circulation assessments, potentially overcoming existing limitations with reduction in background signals and high temporal and spatial resolution, below the millimeter scale. Successful imaging of blood pooling and impaired flow necessitates tracers with diverse circulation half‐lives optimized for MPI signal generation. Recent MPI tracers show potential in imaging cardiovascular complications, vascular perforations, ischemia, and stroke. The impressive temporal resolution and penetration depth also position MPI as an excellent modality for real‐time vessel perfusion imaging via functional MPI (fMPI). This review summarizes advancements in optimized MPI tracers for imaging blood circulation and analyzes the current state of pre‐clinical applications. This work discusses perspectives on standardization required to transition MPI from a research endeavor to clinical implementation and explore additional clinical indications that may benefit from the unique capabilities of MPI. 
    more » « less
  2. ; ; ; ; ; ; ; ; ; ; et al (, Physica Scripta)
    Abstract Magnetic particle imaging (MPI) is a tracer-based tomographic imaging technique utilized in applications such as lung perfusion imaging, cancer diagnosis, stem cell tracking, etc. The goal of translating MPI to clinical use has prompted studies on further improving the spatial-temporal resolutions of MPI through various methods, including image reconstruction algorithm, scanning trajectory design, magnetic field profile design, and tracer design. Iron oxide magnetic nanoparticles (MNPs) are favored for MPI and magnetic resonance imaging (MRI) over other materials due to their high biocompatibility, low cost, and ease of preparation and surface modification. For core–shell MNPs, the tracers’ magnetic core size and non-magnetic coating layer characteristics can significantly affect MPI signals through dynamic magnetization relaxations. Most works to date have assumed an ensemble of MNP tracers with identical sizes, ignoring that artificially synthesized MNPs typically follow a log-normal size distribution, which can deviate theoretical results from experimental data. In this work, we first characterize the size distributions of four commercially available iron oxide MNP products and then model the collective magnetic responses of these MNPs for MPI applications. For an ensemble of MNP tracers with size standard deviations ofσ, we applied a stochastic Langevin model to study the effect of size distribution on MPI imaging performance. Under an alternating magnetic field (AMF), i.e., the excitation field in MPI, we collected the time domain dynamic magnetizations (M-t curves), magnetization-field hysteresis loops (M-H curves), point-spread functions (PSFs), and higher harmonics from these MNP tracers. The intrinsic MPI spatial resolution, which is related to the full width at half maximum (FWHM) of the PSF profile, along with the higher harmonics, serve as metrics to provide insights into how the size distribution of MNP tracers affects MPI performance. 
    more » « less
  3. ; ; ; ; ; ; ; (, Medical Physics)
    Abstract BackgroundMagnetic resonance imaging (MRI) scans are known to suffer from a variety of acquisition artifacts as well as equipment‐based variations that impact image appearance and segmentation performance. It is still unclear whether a direct relationship exists between magnetic resonance (MR) image quality metrics (IQMs) (e.g., signal‐to‐noise, contrast‐to‐noise) and segmentation accuracy. PurposeDeep learning (DL) approaches have shown significant promise for automated segmentation of brain tumors on MRI but depend on the quality of input training images. We sought to evaluate the relationship between IQMs of input training images and DL‐based brain tumor segmentation accuracy toward developing more generalizable models for multi‐institutional data. MethodsWe trained a 3D DenseNet model on the BraTS 2020 cohorts for segmentation of tumor subregions enhancing tumor (ET), peritumoral edematous, and necrotic and non‐ET on MRI; with performance quantified via a 5‐fold cross‐validated Dice coefficient. MRI scans were evaluated through the open‐source quality control tool MRQy, to yield 13 IQMs per scan. The Pearson correlation coefficient was computed between whole tumor (WT) dice values and IQM measures in the training cohorts to identify quality measures most correlated with segmentation performance. Each selected IQM was used to group MRI scans as “better” quality (BQ) or “worse” quality (WQ), via relative thresholding. Segmentation performance was re‐evaluated for the DenseNet model when (i) training on BQ MRI images with validation on WQ images, as well as (ii) training on WQ images, and validation on BQ images. Trends were further validated on independent test sets derived from the BraTS 2021 training cohorts. ResultsFor this study, multimodal MRI scans from the BraTS 2020 training cohorts were used to train the segmentation model and validated on independent test sets derived from the BraTS 2021 cohort. Among the selected IQMs, models trained on BQ images based on inhomogeneity measurements (coefficient of variance, coefficient of joint variation, coefficient of variation of the foreground patch) and the models trained on WQ images based on noise measurement peak signal‐to‐noise ratio (SNR) yielded significantly improved tumor segmentation accuracy compared to their inverse models. ConclusionsOur results suggest that a significant correlation may exist between specific MR IQMs and DenseNet‐based brain tumor segmentation performance. The selection of MRI scans for model training based on IQMs may yield more accurate and generalizable models in unseen validation. 
    more » « less
  4. ; (, BMC Methods)
    Abstract BackgroundTo address the limitations of large-scale high quality microscopy image acquisition, PSSR (Point-Scanning Super-Resolution) was introduced to enhance easily acquired low quality microscopy data to a higher quality using deep learning-based methods. However, while PSSR was released as open-source, it was difficult for users to implement into their workflows due to an outdated codebase, limiting its usage by prospective users. Additionally, while the data enhancements provided by PSSR were significant, there was still potential for further improvement. MethodsTo overcome this, we introduce PSSR2, a redesigned implementation of PSSR workflows and methods built to put state-of-the-art technology into the hands of the general microscopy and biology research community. PSSR2 enables user-friendly implementation of super-resolution workflows for simultaneous super-resolution and denoising of undersampled microscopy data, especially through its integrated Command Line Interface and Napari plugin. PSSR2 improves and expands upon previously established PSSR algorithms, mainly through improvements in the semi-synthetic data generation (“crappification”) and training processes. ResultsIn benchmarking PSSR2 on a test dataset of paired high and low resolution electron microscopy images, PSSR2 super-resolves high-resolution images from low-resolution images to a significantly higher accuracy than PSSR. The super-resolved images are also more visually representative of real-world high-resolution images. DiscussionThe improvements in PSSR2, in providing higher quality images, should improve the performance of downstream analyses. We note that for accurate super-resolution, PSSR2 models should only be applied to super-resolve data sufficiently similar to training data and should be validated against real-world ground truth data. 
    more » « less
  5. ; ; ; ; (, Nanoscale Advances)
    Magnetic particle imaging (MPI) is a novel biomedical imaging modality that allows non-invasive, tomographic, and quantitative tracking of the distribution of superparamagnetic iron oxide nanoparticle (SPION) tracers. While MPI possesses high sensitivity, detecting nanograms of iron, it does not provide anatomical information. Computed tomography (CT) is a widely used biomedical imaging modality that yields anatomical information at high resolution. A multimodal imaging agent combining the benefits of MPI and CT imaging would be of interest. Here we combine MPI-tailored SPIONs with CT-contrast hafnium oxide (hafnia) nanoparticles using flash nanoprecipitation to obtain dual-imaging MPI/CT agents. Co-encapsulation of iron oxide and hafnia in the composite nanoparticles was confirmed via transmission electron microscopy and elemental mapping. Equilibrium and dynamic magnetic characterization show a reduction in effective magnetic diameter and changes in dynamic magnetic susceptibility spectra at high oscillating field frequencies, suggesting magnetic interactions within the composite dual imaging tracers. The MPI performance of the dual imaging agent was evaluated and compared to the commercial tracer ferucarbotran. The dual-imaging agent has MPI sensitivity that is ∼3× better than this commercial tracer. However, worsening of MPI resolution was observed in the composite tracer when compared to individually coated SPIONs. This worsening resolution could result from magnetic dipolar interactions within the composite dual imaging tracer. The CT performance of the dual imaging agent was evaluated in a pre-clinical animal scanner and a clinical scanner, revealing better contrast compared to a commercial iodine-based contrast agent. We demonstrate that the dual imaging agent can be differentiated from the commercial iodine contrast agent using dual energy CT (DECT) imaging. Furthermore, the dual imaging agent displayed energy-dependent CT contrast arising from the combination of SPION and hafnia, making it potentially suitable for virtual monochromatic imaging of the contrast agent distribution using DECT. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email