skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Decoding the Hidden: Direct Image Classification Using Coded Aperture Imaging
Coded aperture imaging has emerged as a solution to enhance light sensitivity and enable imaging in challenging conditions. However, the computational expense of image reconstruction poses limitations in processing efficiency. To address this, we propose a direct classification method using convolutional neural networks. By leveraging raw coded measurements, our approach eliminates the need for explicit image reconstruction, reducing computational overhead. We evaluate the effectiveness of this approach compared to traditional methods on the MNIST and CIFAR10 datasets. Our results demonstrate that direct image classification using raw coded measurements achieves comparable performance to traditional methods while reducing computational overhead and enabling real-time processing. These findings highlight the potential of machine learning in enhancing the decoding process and improving the overall performance of coded aperture imaging systems.  more » « less
Award ID(s):
1840265
PAR ID:
10505323
Author(s) / Creator(s):
; ;
Publisher / Repository:
IEEE
Date Published:
Journal Name:
2023 IEEE 9th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)
ISBN:
979-8-3503-4452-3
Page Range / eLocation ID:
361 to 365
Format(s):
Medium: X
Location:
Herradura, Costa Rica
Sponsoring Org:
National Science Foundation
More Like this
  1. Coded aperture X-ray computed tomography is a computational imaging technique capable of reconstructing inner structures of an object from a reduced set of X-ray projection measurements. Coded apertures are placed in front of the X-ray sources from different views and thus significantly reduce the radiation dose. This paper introduces coded aperture X-ray computed tomography for robotic X-ray systems which offer positioning flexibility. While single coded-aperture 3D tomography was recently introduced for standard trajectory CT scanning, it is shown that significant gains in imaging performance can be attained by simple modifications in the CT scanning trajectories enabled by emerging dual robotic CT systems. In particular, the subject is fixed on a plane and the CT system uniformly rotates around ther −axis which is misaligned with the coordinate axes. A single stationary coded aperture is placed on front of the robotic X-ray source above the plane and the corresponding X-ray projections are measured by a two-dimensional detector on the second arm of the robotic system. The compressive measurements with misalignment enable the reconstruction of high-resolution three-dimensional volumetric images from the low-resolution coded projections on the detector at a sub-sampling rate. An efficient algorithm is proposed to generate the rotation matrix with two basic sub-matrices and thus the forward model is formulated. The stationary coded aperture is designed based on the Pearson product-moment correlation coefficient analysis and the direct binary search algorithm is used to obtain the optimized coded aperture. Simulations using simulated datasets show significant gains in reconstruction performance compared to conventional coded aperture CT systems. 
    more » « less
  2. Abstract: Coded aperture X-ray computed tomography (CT) has the potential to revolutionize X-ray tomography systems in medical imaging and air and rail transit security - both areas of global importance. It allows either a reduced set of measurements in X-ray CT without degrada- tion in image reconstruction, or measure multiplexed X-rays to simplify the sensing geometry. Measurement reduction is of particular interest in medical imaging to reduce radiation, and airport security often imposes practical constraints leading to limited angle geometries. Coded aperture compressive X-ray CT places a coded aperture pattern in front of the X-ray source in order to obtain patterned projections onto a detector. Compressive sensing (CS) reconstruction algorithms are then used to recover the image. To date, the coded illumination patterns used in conventional CT systems have been random. This paper addresses the code optimization prob- lem for general tomography imaging based on the point spread function (PSF) of the system, which is used as a measure of the sensing matrix quality which connects to the restricted isom- etry property (RIP) and coherence of the sensing matrix. The methods presented are general, simple to use, and can be easily extended to other imaging systems. Simulations are presented where the peak signal to noise ratios (PSNR) of the reconstructed images using optimized coded apertures exhibit significant gain over those attained by random coded apertures. Additionally, results using real X-ray tomography projections are presented. 
    more » « less
  3. Abstract: Coded aperture X-ray computed tomography (CT) has the potential to revolutionize X-ray tomography systems in medical imaging and air and rail transit security - both areas of global importance. It allows either a reduced set of measurements in X-ray CT without degrada- tion in image reconstruction, or measure multiplexed X-rays to simplify the sensing geometry. Measurement reduction is of particular interest in medical imaging to reduce radiation, and airport security often imposes practical constraints leading to limited angle geometries. Coded aperture compressive X-ray CT places a coded aperture pattern in front of the X-ray source in order to obtain patterned projections onto a detector. Compressive sensing (CS) reconstruction algorithms are then used to recover the image. To date, the coded illumination patterns used in conventional CT systems have been random. This paper addresses the code optimization prob- lem for general tomography imaging based on the point spread function (PSF) of the system, which is used as a measure of the sensing matrix quality which connects to the restricted isom- etry property (RIP) and coherence of the sensing matrix. The methods presented are general, simple to use, and can be easily extended to other imaging systems. Simulations are presented where the peak signal to noise ratios (PSNR) of the reconstructed images using optimized coded apertures exhibit significant gain over those attained by random coded apertures. Additionally, results using real X-ray tomography projections are presented. 
    more » « less
  4. Coded aperture X-ray CT (CAXCT) is a new low-dose imaging technology that promises far-reaching benefits in industrial and clinical applications. It places various coded apertures (CA) at a time in front of the X-ray source to partially block the radiation. The ill-posed inverse reconstruction problem is then solved using l1-norm-based iterative reconstruction methods. Unfortunately, to attain high-quality reconstructions, the CA patterns must change in concert with the view-angles making the implementation impractical. This paper proposes a simple yet radically different approach to CAXCT, which is coined StaticCodeCT, that uses a single-static CA in the CT gantry, thus making the imaging system amenable for practical implementations. Rather than using conventional compressed sensing algorithms for recovery, we introduce a new reconstruction framework for StaticCodeCT. Namely, we synthesize the missing measurements using low-rank tensor completion principles that exploit the multi-dimensional data correlation and low-rank nature of a 3-way tensor formed by stacking the 2D coded CT projections. Then, we use the FDK algorithm to recover the 3D object. Computational experiments using experimental projection measurements exhibit up to 10% gains in the normalized root mean square distance of the reconstruction using the proposed method compared with those attained by alternative low-dose systems. 
    more » « less
  5. The applications of conventional ptychography are limited by its relatively low resolution and throughput in the visible light regime. The new development of coded ptychography (CP) has addressed these issues and achieved the highest numerical aperture for large-area optical imaging in a lensless configuration. A high-quality reconstruction of CP relies on precise tracking of the coded sensor’s positional shifts. The coded layer on the sensor, however, prevents the use of cross correlation analysis for motion tracking. Here we derive and analyze the motion tracking model of CP. A novel, to the best of our knowledge, remote referencing scheme and its subsequent refinement pipeline are developed for blind image acquisition. By using this approach, we can suppress the correlation peak caused by the coded surface and recover the positional shifts with deep sub-pixel accuracy. In contrast with common positional refinement methods, the reported approach can be disentangled from the iterative phase retrieval process and is computationally efficient. It allows blind image acquisition without motion feedback from the scanning process. It also provides a robust and reliable solution for implementing ptychography with high imaging throughput. We validate this approach by performing high-resolution whole slide imaging of bio-specimens. 
    more » « less