Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 5:00 PM ET until 8:00 PM ET on Friday, September 11 due to maintenance. We apologize for the inconvenience.


Title: Neural nano-optics for high-quality thin lens imaging
Abstract Nano-optic imagers that modulate light at sub-wavelength scales could enable new applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In this work, we close this performance gap by introducing a neural nano-optics imager. We devise a fully differentiable learning framework that learns a metasurface physical structure in conjunction with a neural feature-based image reconstruction algorithm. Experimentally validating the proposed method, we achieve an order of magnitude lower reconstruction error than existing approaches. As such, we present a high-quality, nano-optic imager that combines the widest field-of-view for full-color metasurface operation while simultaneously achieving the largest demonstrated aperture of 0.5 mm at an f-number of 2.  more » « less
Award ID(s):
2127235 1825308
PAR ID:
10343716
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Nature Communications
Volume:
12
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The demand for high-resolution optical systems with a compact form factor, such as augmented reality displays, sensors, and mobile cameras, requires creating new optical component architectures. Advances in the design and fabrication of freeform optics and metasurfaces make them potential solutions to address the previous needs. Here, we introduce the concept of a metaform—an optical surface that integrates the combined benefits of a freeform optic and a metasurface into a single optical component. We experimentally realized a miniature imager using a metaform mirror. The mirror is fabricated via an enhanced electron beam lithography process on a freeform substrate. The design degrees of freedom enabled by a metaform will support a new generation of optical systems. 
    more » « less
  2. Abstract We report an inverse-designed, high numerical aperture (∼0.44), extended depth of focus (EDOF) meta-optic, which exhibits a lens-like point spread function (PSF). The EDOF meta-optic maintains a focusing efficiency comparable to that of a hyperboloid metalens throughout its depth of focus. Exploiting the extended depth of focus and computational post processing, we demonstrate broadband imaging across the full visible spectrum using a 1 mm, f/1 meta-optic. Unlike other canonical EDOF meta-optics, characterized by phase masks such as a log-asphere or cubic function, our design exhibits a highly invariant PSF across ∼290 nm optical bandwidth, which leads to significantly improved image quality, as quantified by structural similarity metrics. 
    more » « less
  3. Designing with freeform optics makes it possible to correct imaging systems to high-performance levels in a compact format. To justify the extra challenges inherent in the design, fabrication, metrology, and assembly of systems utilizing freeform optics, engineers need a realistic understanding of the performance that can be expected. The real-world performance of these systems has remained under-explored in the literature, a factor that may dissuade the adoption of freeform optics. In this work, the MTF of an F/3, 3° diagonal full FOV, 250-mm aperture freeform telescope is characterized at multiple field angles using an off-axis parabolic collimator. The freeform optic components required minimal alignment steps and no post-polishing. Twenty-seven sub-aperture tilted knife-edge tests were conducted to evaluate the correlation between form error and image quality. The telescope’s image quality was determined to be consistent with the design specification, which was 30% MTF at 76 lp/mm (70% of the sensor-array Nyquist frequency) across the entire field. 
    more » « less
  4. null (Ed.)
    Lensless imaging is a new, emerging modality where image sensors utilize optical elements in front of the sensor to perform multiplexed imaging. There have been several recent papers to reconstruct images from lensless imagers, including methods that utilize deep learning for state-of-the-art performance. However, many of these methods require explicit knowledge of the optical element, such as the point spread function, or learn the reconstruction mapping for a single fixed PSF. In this paper, we explore a neural network architecture that performs joint image reconstruction and PSF estimation to robustly recover images captured with multiple PSFs from different cameras. Using adversarial learning, this approach achieves improved reconstruction results that do not require explicit knowledge of the PSF at test-time and shows an added improvement in the reconstruction model’s ability to generalize to variations in the camera’s PSF. This allows lensless cameras to be utilized in a wider range of applications that require multiple cameras without the need to explicitly train a separate model for each new camera. 
    more » « less
  5. Abstract Optical metasurfaces, consisting of subwavelength‐scale meta‐atom arrays, hold great promise of overcoming the fundamental limitations of conventional optics. Due to their structural complexity, metasurfaces usually require high‐resolution yet slow and expensive fabrication processes. Here, using a metasurface polarimetric imaging device as an example, the photonic structures and the Nanoimprint lithography (NIL) processes are designed, creating two separate NIL molds over a patterning area of > 20 mm2with designed Moiré alignment markers by electron‐beam writing, and further subsequently integrate silicon and aluminum metasurface structures on a chip. Uniquely, the silicon and aluminum metasurfaces are fabricated by using the nanolithography and 3D pattern‐transfer capabilities of NIL, respectively, achieving nanometer‐scale linewidth uniformity, sub‐200 nm translational overlay accuracy, and <0.017 rotational alignment error while significantly reducing fabrication complexity and surface roughness. The micro‐sized multilayer metasurfaces have high circular polarization extinction ratios as large as ≈20 and ≈80 in blue and red wavelengths. Further, the metasurface chip‐integrated CMOS imager demonstrates high accuracy in broad‐band, full Stokes parameter analysis in the visible wavelength ranges and single‐shot polarimetric imaging. This novel, NIL‐based, multilayered nanomanufacturing approach is applicable to the scalable production of large‐area functional structures for ultra‐compact optic, electronic, and quantum devices. 
    more » « less