skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Neural nano-optics for high-quality thin lens imaging
Abstract Nano-optic imagers that modulate light at sub-wavelength scales could enable new applications in diverse domains ranging from robotics to medicine. Although metasurface optics offer a path to such ultra-small imagers, existing methods have achieved image quality far worse than bulky refractive alternatives, fundamentally limited by aberrations at large apertures and low f-numbers. In this work, we close this performance gap by introducing a neural nano-optics imager. We devise a fully differentiable learning framework that learns a metasurface physical structure in conjunction with a neural feature-based image reconstruction algorithm. Experimentally validating the proposed method, we achieve an order of magnitude lower reconstruction error than existing approaches. As such, we present a high-quality, nano-optic imager that combines the widest field-of-view for full-color metasurface operation while simultaneously achieving the largest demonstrated aperture of 0.5 mm at an f-number of 2.  more » « less
Award ID(s):
2127235 1825308
PAR ID:
10360725
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Volume:
12
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract We report an inverse-designed, high numerical aperture (∼0.44), extended depth of focus (EDOF) meta-optic, which exhibits a lens-like point spread function (PSF). The EDOF meta-optic maintains a focusing efficiency comparable to that of a hyperboloid metalens throughout its depth of focus. Exploiting the extended depth of focus and computational post processing, we demonstrate broadband imaging across the full visible spectrum using a 1 mm, f/1 meta-optic. Unlike other canonical EDOF meta-optics, characterized by phase masks such as a log-asphere or cubic function, our design exhibits a highly invariant PSF across ∼290 nm optical bandwidth, which leads to significantly improved image quality, as quantified by structural similarity metrics. 
    more » « less
  2. null (Ed.)
    The demand for high-resolution optical systems with a compact form factor, such as augmented reality displays, sensors, and mobile cameras, requires creating new optical component architectures. Advances in the design and fabrication of freeform optics and metasurfaces make them potential solutions to address the previous needs. Here, we introduce the concept of a metaform—an optical surface that integrates the combined benefits of a freeform optic and a metasurface into a single optical component. We experimentally realized a miniature imager using a metaform mirror. The mirror is fabricated via an enhanced electron beam lithography process on a freeform substrate. The design degrees of freedom enabled by a metaform will support a new generation of optical systems. 
    more » « less
  3. Abstract Optical metasurfaces, consisting of subwavelength‐scale meta‐atom arrays, hold great promise of overcoming the fundamental limitations of conventional optics. Due to their structural complexity, metasurfaces usually require high‐resolution yet slow and expensive fabrication processes. Here, using a metasurface polarimetric imaging device as an example, the photonic structures and the Nanoimprint lithography (NIL) processes are designed, creating two separate NIL molds over a patterning area of > 20 mm2with designed Moiré alignment markers by electron‐beam writing, and further subsequently integrate silicon and aluminum metasurface structures on a chip. Uniquely, the silicon and aluminum metasurfaces are fabricated by using the nanolithography and 3D pattern‐transfer capabilities of NIL, respectively, achieving nanometer‐scale linewidth uniformity, sub‐200 nm translational overlay accuracy, and <0.017 rotational alignment error while significantly reducing fabrication complexity and surface roughness. The micro‐sized multilayer metasurfaces have high circular polarization extinction ratios as large as ≈20 and ≈80 in blue and red wavelengths. Further, the metasurface chip‐integrated CMOS imager demonstrates high accuracy in broad‐band, full Stokes parameter analysis in the visible wavelength ranges and single‐shot polarimetric imaging. This novel, NIL‐based, multilayered nanomanufacturing approach is applicable to the scalable production of large‐area functional structures for ultra‐compact optic, electronic, and quantum devices. 
    more » « less
  4. A freeform pushbroom hyperspectral imager design was investigated as a combination of a freeform reflective triplet imager and a freeform reflective triplet spectrometer used in double-pass. The design operates at about F/2 with a 15-degree cross-track field-of-view and a 30 mm entrance pupil diameter. The design process led to achieving a small volume of less than 2 liters that fits comfortably within a 3U CubeSat geometry, exemplifying the compactness of this hyperspectral imager. We report the freeform sag departures and maximum slopes of the freeform surfaces, as well as the manufacturing tolerances together with an evaluation of the system stray light, all of which highlight the feasibility of a design in this class to be manufactured. This design uniquely positions itself on the landscape of compact hyperspectral imagers. 
    more » « less
  5. null (Ed.)
    Lensless imaging is a new, emerging modality where image sensors utilize optical elements in front of the sensor to perform multiplexed imaging. There have been several recent papers to reconstruct images from lensless imagers, including methods that utilize deep learning for state-of-the-art performance. However, many of these methods require explicit knowledge of the optical element, such as the point spread function, or learn the reconstruction mapping for a single fixed PSF. In this paper, we explore a neural network architecture that performs joint image reconstruction and PSF estimation to robustly recover images captured with multiple PSFs from different cameras. Using adversarial learning, this approach achieves improved reconstruction results that do not require explicit knowledge of the PSF at test-time and shows an added improvement in the reconstruction model’s ability to generalize to variations in the camera’s PSF. This allows lensless cameras to be utilized in a wider range of applications that require multiple cameras without the need to explicitly train a separate model for each new camera. 
    more » « less