Both 3D imaging and hyperspectral imaging provide important information of the scene and combining them is beneficial in helping us perceive and understand real-world structures. Previous hyperspectral 3D imaging systems typically require a hyperspectral imaging system as the detector suffers from complicated hardware design, high cost, and high acquisition and reconstruction time. Here, we report a low-cost, high-frame rate, simple-design, and compact hyperspectral stripe projector (HSP) system based on a single digital micro-mirror device, capable of producing hyperspectral patterns where each row of pixels has an independently programmable spectrum. We demonstrate two example applications using the HSP via hyperspectral structured illumination: hyperspectral 3D surface imaging and spectrum-dependent hyperspectral compressive imaging of volume density of participating medium. The hyperspectral patterns simultaneously encode the 3D spatial and spectral information of the target, requiring only a grayscale sensor as the detector. The reported HSP and its applications provide a solution for combining structured illumination techniques with hyperspectral imaging in a simple, efficient, and low-cost manner. The work presented here represents a novel structured illumination technique that provides the basis and inspiration of future variations of hardware systems and software encoding schemes.
- Award ID(s):
- 1808331
- NSF-PAR ID:
- 10274176
- Date Published:
- Journal Name:
- Sensors
- Volume:
- 21
- Issue:
- 11
- ISSN:
- 1424-8220
- Page Range / eLocation ID:
- 3652
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
more » « less
Optical projection tomography (OPT) is a three-dimensional (3D) fluorescence imaging technique, in which projection images are acquired for varying orientations of a sample using a large depth of field. OPT is typically applied to a millimeter-sized specimen, because the rotation of a microscopic specimen is challenging and not compatible with live cell imaging. In this Letter, we demonstrate fluorescence optical tomography of a microscopic specimen by laterally translating the tube lens of a wide-field optical microscope, which allows for high-resolution OPT without rotating the sample. The cost is the reduction of the field of view to about halfway along the direction of the tube lens translation. Using bovine pulmonary artery endothelial cells and 0.1 µm beads, we compare the 3D imaging performance of the proposed method with that of the conventional objective-focus scan method.
-
more » « less
We demonstrate hyperspectral confocal microscopy in the short-wave infrared (SWIR) range of 1100–1600 nm using a wavelength-scanning laser in tandem with laser scanning confocal microscopy. Confocal microscopy in the SWIR range allows for high-resolution inspection of an integrated circuit (IC) chip, while hyperspectral imaging, together with a chemometric analysis, enables us to identify functional circuit block groups in the acquired image. With the extended capability, the developed instrument can be potentially used for inline inspection and non-invasive failure analysis of IC chips.
-
more » « less
This work presents the design and fabrication of polymeric, structural optical filters that simultaneously focus light. These filters represent a novel, to the best of our knowledge, design at the boundary between diffractive optics and metasurfaces that may provide significant advantages for both digital and hyperspectral imaging. Filters for visible and near-infrared wavelengths were designed using finite-difference time-domain (FDTD) simulations. Prototype filters were fabricated using two-photon lithography, a form of nanoscale 3D printing, and have geometries suitable to replication by molding. The experimentally measured spectral transmission and focused spot size of each filter show excellent agreement with simulation.
-
We report a novel lensless on-chip microscopy platform based on near-field blind ptychographic modulation. In this platform, we place a thin diffuser in between the object and the image sensor for light wave modulation. By blindly scanning the unknown diffuser to different x – y positions, we acquire a sequence of modulated intensity images for quantitative object recovery. Different from previous ptychographic implementations, we employ a unit magnification configuration with a Fresnel number of ∼50 000, which is orders of magnitude higher than those of previous ptychographic setups. The unit magnification configuration allows us to have the entire sensor area, 6.4 mm by 4.6 mm, as the imaging field of view. The ultra-high Fresnel number enables us to directly recover the positional shift of the diffuser in the phase retrieval process, addressing the positioning accuracy issue plaguing regular ptychographic experiments. In our implementation, we use a low-cost, DIY scanning stage to perform blind diffuser modulation. Precise mechanical scanning that is critical in conventional ptychography experiments is no longer needed in our setup. We further employ an up-sampling phase retrieval scheme to bypass the resolution limit set by the imager pixel size and demonstrate a half-pitch resolution of 0.78 μm. We validate the imaging performance via in vitro cell cultures, transparent and stained tissue sections, and a thick biological sample. We show that the recovered quantitative phase map can be used to perform effective cell segmentation of a dense yeast culture. We also demonstrate 3D digital refocusing of the thick biological sample based on the recovered wavefront. The reported platform provides a cost-effective and turnkey solution for large field-of-view, high-resolution, and quantitative on-chip microscopy. It is adaptable for a wide range of point-of-care-, global-health-, and telemedicine-related applications.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/s21113652
