An official website of the United States government
Sub-wavelength diffractive meta-optics have emerged as a versatile platform to manipulate light fields at will, due to their ultra-small form factor and flexible multifunctionalities. However, miniaturization and multimodality are typically compromised by a reduction in imaging performance; thus, meta-optics often yield lower resolution and stronger aberration compared to traditional refractive optics. Concurrently, computational approaches have become popular to improve the image quality of traditional cameras and exceed limitations posed by refractive lenses. This in turn often comes at the expense of higher power and latency, and such systems are typically limited by the availability of certain refractive optics. Limitations in both fields have thus sparked cross-disciplinary efforts to not only overcome these roadblocks but also to go beyond and provide synergistic meta-optical–digital solutions that surpass the potential of the individual components. For instance, an application-specific meta-optical frontend can preprocess the light field of a scene and focus it onto the sensor with a desired encoding, which can either ease the computational load on the digital backend or can intentionally alleviate certain meta-optical aberrations. In this review, we introduce the fundamentals, summarize the development of meta-optical computational imaging, focus on latest advancements that redefine the current state of the art, and give a perspective on research directions that leverage the full potential of sub-wavelength photonic platforms in imaging and sensing applications. The current advancement of meta-optics and recent investments by foundries and technology partners have the potential to provide synergistic future solutions for highly efficient, compact, and low-power imaging systems.
more »
« less
Foveated thermal computational imaging prototype using all-silicon meta-optics
Foveated imaging provides a better tradeoff between situational awareness (field of view) and resolution, and is critical in long wavelength infrared regimes because of the size, weight, power, and cost of thermal sensors. We demonstrate computational foveated imaging by exploiting the ability of a meta-optical frontend to discriminate between different polarization states and a computational backend to reconstruct the captured image/video. The frontend is a three-element optic: the first element, which we call the “foveal” element, is a metalens that focuses s-polarized light at a distance off1without affecting the p-polarized light; the second element, which we call the “perifovea” element, is another metalens that focuses p-polarized light at a distance off2without affecting thes-polarized light. The third element is a freely rotating polarizer that dynamically changes the mixing ratios between the two polarization states. Both the foveal element (focal length=150mm; diameter=75mm) and the perifoveal element (focal length=25mm; diameter=25mm) were fabricated as polarization-sensitive, all-silicon, meta surfaces resulting in a large-aperture, 1:6 foveal expansion, thermal imaging capability. A computational backend then utilizes a deep image prior to separate the resultant multiplexed image or video into a foveated image consisting of a high resolution center and a lower-resolution large field of view context. We build a prototype system and demonstrate 12 frames per second real-time, thermal, foveated image and video capture..
more »
« less
- PAR ID:
- 10484041
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Optica
- Volume:
- 11
- Issue:
- 1
- ISSN:
- 2334-2536
- Format(s):
- Medium: X Size: Article No. 18
- Size(s):
- Article No. 18
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Subwavelength diffractive optics known as meta-optics have demonstrated the potential to significantly miniaturize imaging systems. However, despite impressive demonstrations, most meta-optical imaging systems suffer from strong chromatic aberrations, limiting their utilities. Here, we employ inverse-design to create broadband meta-optics operating in the long-wave infrared (LWIR) regime (8-12μm). Via a deep-learning assisted multi-scale differentiable framework that links meta-atoms to the phase, we maximize the wavelength-averaged volume under the modulation transfer function (MTF) surface of the meta-optics. Our design framework merges local phase-engineering via meta-atoms and global engineering of the scatterer within a single pipeline. We corroborate our design by fabricating and experimentally characterizing all-silicon LWIR meta-optics. Our engineered meta-optic is complemented by a simple computational backend that dramatically improves the quality of the captured image. We experimentally demonstrate a six-fold improvement of the wavelength-averaged Strehl ratio over the traditional hyperboloid metalens for broadband imaging.more » « less
-
Abstract Quantitative phase imaging (QPI) recovers the exact wavefront of light from intensity measurements. Topographical and optical density maps of translucent microscopic bodies can be extracted from these quantified phase shifts. We demonstrate quantitative phase imaging at the tip of a coherent fiber bundle using chromatic aberrations inherent in a silicon nitride hyperboloid metalens. Our method leverages spectral multiplexing to recover phase from multiple defocus planes in a single capture using a color camera. Our 0.5 mm aperture metalens shows robust quantitative phase imaging capability with a$${28}^{\circ}$$ field of view and 0.$${2}{\pi}$$ phase resolution ( ~ 0.$${1}{\lambda}$$ in air) for experiments with an endoscopic fiber bundle. Since the spectral functionality is encoded directly in the imaging lens, the metalens acts both as a focusing element and a spectral filter. The use of a simple computational backend will enable real-time operation. Key limitations in the adoption of phase imaging methods for endoscopy such as multiple acquisition, interferometric alignment or mechanical scanning are completely mitigated in the reported metalens based QPI.more » « less
-
Super-resolution (SR) is a well-studied technique for reconstructing high-resolution (HR) images from low-resolution (LR) ones. SR holds great promise for video streaming since an LR video segment can be transmitted from the video server to the client that then reconstructs the HR version using SR, resulting in a significant reduction in network bandwidth. However, SR is seldom used in practice for real-time video streaming, because the computational overhead of frame reconstruction results in large latency and low frame rate. To reduce the computational overhead and make SR practical, we propose a deep-learning-based SR method called Fo veated Cas caded Video Super Resolution (focas). focas relies on the fact that human eyes only have high acuity in a tiny central foveal region of the retina. focas uses more neural network blocks in the foveal region to provide higher video quality, while using fewer blocks in the periphery as lower quality is sufficient. To optimize the computational resources and reduce reconstruction latency, focas formulates and solves a convex optimization problem to decide the number of neural network blocks to use in each region of the frame. Using extensive experiments, we show that focas reduces the latency by 50%-70% while maintaining comparable visual quality as traditional (non-foveated) SR. Further, focas provides a 12-16x reduction in the client-to-server network bandwidth in comparison with sending the full HR video segments.more » « less
-
Abstract Metalenses, with their ultrathin thicknesses and their ease for achieving ultra small diameters, offer a promising alternative to refractive lenses in miniaturized imaging systems, such as endoscopes, potentially enabling applications in tightly confined spaces. However, traditional metalenses suffer from strong chromatic aberrations, limiting their utility in multi-color imaging. To address this limitation, here we present an inverse-designed polychromatic metalens with a diameter of 680 μm, focal length of 400 μm, and low dispersion across 3 distinct wavelengths at 643 nm, 532 nm, and 444 nm. The metalens collimates and steers light emitted from a scanning fiber tip, generating scanning beams across a 70° field-of-view to provide illumination for a scan-based imaging. The metalens provides a close-to-diffraction-limited 0.5° angular resolution, only restricted by the effective aperture of the system. The average relative efficiency among three design wavelengths is around 32% for on-axis angle and 13% averaged across the entire field-of-view. This work holds promise for the application of metalenses in endoscopes and other miniaturized imaging systems.more » « less
