An official website of the United States government
Abstract Multifocal microscopy enables high-speed three-dimensional (3D) volume imaging by using a multifocal grating in the emission path. This grating is typically designed to afford a uniform illumination of multifocal subimages for a single emission wavelength. Using the same grating for multicolor imaging results in non-uniform subimage intensities in emission wavelengths for which the grating is not designed. This has restricted multifocal microscopy applications for samples having multicolored fluorophores. In this paper, we present a multicolor multifocal microscope implementation which uses a Spatial Light Modulator (SLM) as a single multifocal grating to realize near-uniform multifocal subimage intensities across multiple wavelength emission bands. Using real-time control of an in-situ-optimized SLM implemented as a multifocal grating, we demonstrate multicolor multifocal 3D imaging over three emission bands by imaging multicolored particles as well as Escherichia coli ( E. coli ) interacting with human liver cancer cells, at $$\sim 2.5$$ ∼ 2.5 multicolor 3D volumes per second acquisition speed. Our multicolor multifocal method is adaptable across SLM hardware, emission wavelength band locations and number of emission bands, making it particularly suited for researchers investigating fast processes occurring across a volume where multiple species are involved.
more »
« less
Intensity uniformity optimization in spatial-light-modulator-based multifocal microscope
Multifocal microscopes (MFMs) are becoming increasingly popular in fluorescence microscopy due to their high speed three-dimensional (3D) imaging capabilities. Conventional MFMs use a fixed fabricated grating as the multifocal grating but these are limited to a restricted wavelength range and a fixed object-plane separation. Spatial light modulators (SLMs) represent an alternative to fabricated gratings due to their real-time programmability, providing complete control over emission wavelength range and object plane separations. However, algorithms commonly used to obtain multifocal grating patterns which provide uniform intensity across the subimages are not directly applicable to SLM-based MFMs due to inherent pixel-to-pixel crosstalk effects present in the SLM chip. We recently developed an in-situ iterative algorithm which generates grating patterns that provide near-uniform illumination of the subimages in SLM-based MFMs. This algorithm is universal across wavelengths, object-plane separations, and SLM manufacturers. As part of our efforts to develop an SLM-based MFM that can respond rapidly to changing experimental parameters, we implement a gradient descent-based optimization method. We evaluate its performance in comparison with a grid search based routine. Experimental results obtained on a custom-made SLM-based MFM indicate that the grid-search optimized grating patterns provide superior subimage intensity uniformity versus the gradient-descent method. These experiments also provide an insight into the energy landscape involved in these optimizations. This study increases the utility of SLM-based MFMs in high-speed imaging.
more »
« less
- Award ID(s):
- 1734030
- PAR ID:
- 10229029
- Editor(s):
- Brown, Thomas G.; Wilson, Tony; Waller, Laura
- Date Published:
- Journal Name:
- SPIE BiOS
- Volume:
- 11649
- Issue:
- Processing XXVIII
- Page Range / eLocation ID:
- 26
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Many emerging, high-speed, reconfigurable optical systems are limited by routing complexity when producing dynamic, two-dimensional (2D) electric fields. We propose a gradient-based inverse-designed, static phase-mask doublet to generate arbitrary 2D intensity wavefronts using a one-dimensional (1D) intensity spatial light modulator (SLM). We numerically simulate the capability of mapping each point in a 49 element 1D array to a distinct 2D spatial distribution. Our proposed method will significantly relax the routing complexity of electrical control signals, possibly enabling high-speed, sub-wavelength 2D SLMs leveraging new materials and pixel architectures.more » « less
-
A moiré photonic crystal is an optical analog of twisted graphene. A 3D moiré photonic crystal is a new nano-/microstructure that is distinguished from bilayer twisted photonic crystals. Holographic fabrication of a 3D moiré photonic crystal is very difficult due to the coexistence of the bright and dark regions, where the exposure threshold is suitable for one region but not for the other. In this paper, we study the holographic fabrication of 3D moiré photonic crystals using an integrated system of a single reflective optical element (ROE) and a spatial light modulator (SLM) where nine beams (four inner beams + four outer beams + central beam) are overlapped. By modifying the phase and amplitude of the interfering beams, the interference patterns of 3D moiré photonic crystals are systemically simulated and compared with the holographic structures to gain a comprehensive understanding of SLM-based holographic fabrication. We report the holographic fabrication of phase and beam intensity ratio-dependent 3D moiré photonic crystals and their structural characterization. Superlattices modulated in the z-direction of 3D moiré photonic crystals have been discovered. This comprehensive study provides guidance for future pixel-by-pixel phase engineering in SLM for complex holographic structures.more » « less
-
Hyperspectral imaging (HSI) is a spectroscopic technique which captures images at a high contrast over a wide range of wavelengths to show pixel specific composition. Traditional uses of HSI include: satellite imagery, food distribution quality control and digital archaeological reconstruction. Our lab has focused on developing applications of HSI fluorescence imaging systems to study molecule-specific detection for rapid cell signaling events or real-time endoscopic screening. Previously, we have developed a prototype spectral light source, using our modified imaging technique, excitationscanning hyperspectral imaging (HIFEX), coupled to a commercial colonoscope for feasibility testing. The 16 wavelength LED array was combined, using a multi-branched solid light guide, to couple to the scope’s optical input. The prototype acquired a spectral scan at near video-rate speeds (~8 fps). The prototype could operate at very rapid wavelength switch speeds, limited to the on/off rates of the LEDs (~10 μs), but imaging speed was limited due to optical transmission losses (~98%) through the solid light guide. Here we present a continuation of our previous work in performing an in-depth analysis of the solid light guide to optimize the optical intensity throughput. The parameters evaluated include: LED intensity input, geometry (branch curvature and combination) and light propagation using outer claddings. Simulations were conducted using a Monte Carlo ray tracing software (TracePro). Results show that transmission within the branched light guide may be optimized through LED focusing lenses, bend radii and smooth tangential branch merges. Future work will test a new fabricated light guide from the optimized model framework.more » « less
-
The need for high-speed imaging in applications such as biomedicine, surveillance, and consumer electronics has called for new developments of imaging systems. While the industrial effort continuously pushes the advance of silicon focal plane array image sensors, imaging through a single-pixel detector has gained significant interest thanks to the development of computational algorithms. Here, we present a new imaging modality, deep compressed imaging via optimized-pattern scanning, which can significantly increase the acquisition speed for a single-detector-based imaging system. We project and scan an illumination pattern across the object and collect the sampling signal with a single-pixel detector. We develop an innovative end-to-end optimized auto-encoder, using a deep neural network and compressed sensing algorithm, to optimize the illumination pattern, which allows us to reconstruct faithfully the image from a small number of measurements, with a high frame rate. Compared with the conventional switching-mask-based single-pixel camera and point-scanning imaging systems, our method achieves a much higher imaging speed, while retaining a similar imaging quality. We experimentally validated this imaging modality in the settings of both continuous-wave illumination and pulsed light illumination and showed high-quality image reconstructions with a high compressed sampling rate. This new compressed sensing modality could be widely applied in different imaging systems, enabling new applications that require high imaging speeds.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1117/12.2578859
