An official website of the United States government
Inspired by their success in solving challenging inverse problems in computer vision, implicit neural representations (INRs) have been recently proposed for reconstruction in low-dose/sparse-view X-ray computed tomography (CT). An INR represents a CT image as a small-scale neural network that takes spatial coordinates as inputs and outputs attenuation values. Fitting an INR to sinogram data is similar to classical model-based iterative reconstruction methods. However, training INRs with losses and gradient-based algorithms can be prohibitively slow, taking many thousands of iterations to converge. This paper investigates strategies to accelerate the optimization of INRs for CT reconstruction. In particular, we propose two approaches: (1) using a modified loss function with improved conditioning, and (2) an algorithm based on the alternating direction method of multipliers. We illustrate that both of these approaches significantly accelerate INR-based reconstruction of a synthetic breast CT phantom in a sparse-view setting.
more »
« less
Continuous Domain Reconstruction in CT Imaging with Coordinate-based Neural Networks
The majority of iterative algorithms for CT reconstruction rely on discrete-to-discrete modeling, where both the sinogram measurements and image to be estimated are discrete arrays. However, tomographic projections are ideally modeled as line integrals of a continuous attenuation function, i.e., the true inverse problem is discrete-to-continuous in nature. Recently, coordinate-based neural networks (CBNNs), also known as implicit neural representations, have gained traction as a flexible type of continuous domain image representation in a variety of inverse problems arising in computer vision and computational imaging. Using standard neural network training techniques, a CBNN can be fit to measurements to give a continuous domain estimate of the image. In this study, we empirically investigate the potential of CBNNs to solve the continuous domain inverse problems in CT imaging. In particular, we experiment with reconstructing an analytical phantom from its ideal sparse-view sinogram measurements. Our results illustrate that reconstruction with a CBNN are more accurate than filtered back projection and algebraic reconstruction techniques at a variety of resolutions, and competitive with total variation regularized iterative reconstruction.
more »
« less
- Award ID(s):
- 2153371
- PAR ID:
- 10611365
- Publisher / Repository:
- https://www.ct-meeting.org/
- Date Published:
- Format(s):
- Medium: X
- Location:
- Bamberg, Germany
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundComputed tomography (CT) reconstruction problems are always framed as inverse problems, where the attenuation map of an imaged object is reconstructed from the sinogram measurement. In practice, these inverse problems are often ill‐posed, especially under few‐view and limited‐angle conditions, which makes accurate reconstruction challenging. Existing solutions use regularizations such as total variation to steer reconstruction algorithms to the most plausible result. However, most prevalent regularizations rely on the same priors, such as piecewise constant prior, hindering their ability to collaborate effectively and further boost reconstruction precision. PurposeThis study aims to overcome the aforementioned challenge a prior previously limited to discrete tomography. This enables more accurate reconstructions when the proposed method is used in conjunction with most existing regularizations as they utilize different priors. The improvements will be demonstrated through experiments conducted under various conditions. MethodsInspired by the discrete algebraic reconstruction technique (DART) algorithm for discrete tomography, we find out that pixel grayscale values in CT images are not uniformly distributed and are actually highly clustered. Such discovery can be utilized as a powerful prior for CT reconstruction. In this paper, we leverage the collaborative filtering technique to enable the collaboration of the proposed prior and most existing regularizations, significantly enhancing the reconstruction accuracy. ResultsOur experiments show that the proposed method can work with most existing regularizations and significantly improve the reconstruction quality. Such improvement is most pronounced under limited‐angle and few‐view conditions. Furthermore, the proposed regularization also has the potential for further improvement and can be utilized in other image reconstruction areas. ConclusionsWe propose improving the performance of iterative CT reconstruction algorithms by applying the collaborative filtering technique along with a prior based on the densely clustered distribution of pixel grayscale values in CT images. Our experimental results indicate that the proposed methodology consistently enhances reconstruction accuracy when used in conjunction with most existing regularizations, particularly under few‐view and limited‐angle conditions.more » « less
-
Abstract Computed Tomography (CT) has been widely adopted in medicine and it is increasingly being used in scientific and industrial applications. Parallelly, research in different mathematical areas concerning discrete inverse problems has led to the development of new sophisticated numerical solvers that can be applied in the context of CT. The Tomographic Iterative GPU-based Reconstruction (TIGRE) toolbox was born almost a decade ago precisely in the gap between mathematics and high performance computing for real CT data, providing user-friendly open-source software tools for image reconstruction. However, since its inception, the tools’ features and codebase have had over a twenty-fold increase, and are now including greater geometric flexibility, a variety of modern algorithms for image reconstruction, high-performance computing features and support for other CT modalities, like proton CT. The purpose of this work is two-fold: first, it provides a structured overview of the current version of the TIGRE toolbox, providing appropriate descriptions and references, and serving as a comprehensive and peer-reviewed guide for the user; second, it is an opportunity to illustrate the performance of several of the available solvers showcasing real CT acquisitions, which are typically not be openly available to algorithm developers.more » « less
-
We propose a novel Learned Alternating Minimization Algorithm (LAMA) for dual-domain sparse-view CT image reconstruction. LAMA is naturally induced by a variational model for CT reconstruction with learnable nonsmooth nonconvex regularizers, which are parameterized as composite functions of deep networks in both image and sinogram domains. To minimize the objective of the model, we incorporate the smoothing technique and residual learning architecture into the design of LAMA. We show that LAMA substantially reduces network complexity, improves memory efficiency and reconstruction accuracy, and is provably convergent for reliable reconstructions. Extensive numerical experiments demonstrate that LAMA outperforms existing methods by a wide margin on multiple benchmark CT datasets.more » « less
-
Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal estimate, which is known to be fragile; (2) learn a prior for the signal to use in an optimization-based recovery. Despite the impressive results from the latter approach, many of these methods also lack robustness to shifts in data distribution, measurements, and noise levels. Such domain shifts result in a performance gap and in some cases introduce undesired artifacts in the estimated signal. In this paper, we explore the qualitative and quantitative effects of various domain shifts and propose a flexible and parameter efficient framework that adapts pretrained networks to such shifts. We demonstrate the effectiveness of our method for a number of reconstruction tasks that involve natural image, MRI, and CT imaging domains under distribution, measurement model, and noise level shifts. Our experiments demonstrate that our method achieves competitive performance compared to independently fully trained networks, while requiring significantly fewer additional parameters, and outperforms several domain adaptation techniques.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
