skip to main content

This content will become publicly available on March 17, 2024

Title: Geometric deep optical sensing
BACKGROUND Optical sensing devices measure the rich physical properties of an incident light beam, such as its power, polarization state, spectrum, and intensity distribution. Most conventional sensors, such as power meters, polarimeters, spectrometers, and cameras, are monofunctional and bulky. For example, classical Fourier-transform infrared spectrometers and polarimeters, which characterize the optical spectrum in the infrared and the polarization state of light, respectively, can occupy a considerable portion of an optical table. Over the past decade, the development of integrated sensing solutions by using miniaturized devices together with advanced machine-learning algorithms has accelerated rapidly, and optical sensing research has evolved into a highly interdisciplinary field that encompasses devices and materials engineering, condensed matter physics, and machine learning. To this end, future optical sensing technologies will benefit from innovations in device architecture, discoveries of new quantum materials, demonstrations of previously uncharacterized optical and optoelectronic phenomena, and rapid advances in the development of tailored machine-learning algorithms. ADVANCES Recently, a number of sensing and imaging demonstrations have emerged that differ substantially from conventional sensing schemes in the way that optical information is detected. A typical example is computational spectroscopy. In this new paradigm, a compact spectrometer first collectively captures the comprehensive spectral information of more » an incident light beam using multiple elements or a single element under different operational states and generates a high-dimensional photoresponse vector. An advanced algorithm then interprets the vector to achieve reconstruction of the spectrum. This scheme shifts the physical complexity of conventional grating- or interference-based spectrometers to computation. Moreover, many of the recent developments go well beyond optical spectroscopy, and we discuss them within a common framework, dubbed “geometric deep optical sensing.” The term “geometric” is intended to emphasize that in this sensing scheme, the physical properties of an unknown light beam and the corresponding photoresponses can be regarded as points in two respective high-dimensional vector spaces and that the sensing process can be considered to be a mapping from one vector space to the other. The mapping can be linear, nonlinear, or highly entangled; for the latter two cases, deep artificial neural networks represent a natural choice for the encoding and/or decoding processes, from which the term “deep” is derived. In addition to this classical geometric view, the quantum geometry of Bloch electrons in Hilbert space, such as Berry curvature and quantum metrics, is essential for the determination of the polarization-dependent photoresponses in some optical sensors. In this Review, we first present a general perspective of this sensing scheme from the viewpoint of information theory, in which the photoresponse measurement and the extraction of light properties are deemed as information-encoding and -decoding processes, respectively. We then discuss demonstrations in which a reconfigurable sensor (or an array thereof), enabled by device reconfigurability and the implementation of neural networks, can detect the power, polarization state, wavelength, and spatial features of an incident light beam. OUTLOOK As increasingly more computing resources become available, optical sensing is becoming more computational, with device reconfigurability playing a key role. On the one hand, advanced algorithms, including deep neural networks, will enable effective decoding of high-dimensional photoresponse vectors, which reduces the physical complexity of sensors. Therefore, it will be important to integrate memory cells near or within sensors to enable efficient processing and interpretation of a large amount of photoresponse data. On the other hand, analog computation based on neural networks can be performed with an array of reconfigurable devices, which enables direct multiplexing of sensing and computing functions. We anticipate that these two directions will become the engineering frontier of future deep sensing research. On the scientific frontier, exploring quantum geometric and topological properties of new quantum materials in both linear and nonlinear light-matter interactions will enrich the information-encoding pathways for deep optical sensing. In addition, deep sensing schemes will continue to benefit from the latest developments in machine learning. Future highly compact, multifunctional, reconfigurable, and intelligent sensors and imagers will find applications in medical imaging, environmental monitoring, infrared astronomy, and many other areas of our daily lives, especially in the mobile domain and the internet of things. Schematic of deep optical sensing. The n -dimensional unknown information ( w ) is encoded into an m -dimensional photoresponse vector ( x ) by a reconfigurable sensor (or an array thereof), from which w′ is reconstructed by a trained neural network ( n ′ = n and w′   ≈   w ). Alternatively, x may be directly deciphered to capture certain properties of w . Here, w , x , and w′ can be regarded as points in their respective high-dimensional vector spaces ℛ n , ℛ m , and ℛ n ′ . « less
; ; ; ; ; ;
Award ID(s):
1945351 2105139
Publication Date:
Journal Name:
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Metasurfaces, as a two-dimensional (2D) version of metamaterials, have drawn considerable attention for their revolutionary capability in manipulating the amplitude, phase, and polarization of light. As one of the most important types of metasurfaces, geometric metasurfaces provide a versatile platform for controlling optical phase distributions due to the geometric nature of the generated phase profile. However, it remains a great challenge to design geometric metasurfaces for realizing spin-switchable functionalities because the generated phase profile with the converted spin is reversed once the handedness of the incident beam is switched. Here, we propose and experimentally demonstrate chiral geometric metasurfaces based on intrinsically chiral plasmonic stepped nanoapertures with a simultaneously high circular dichroism in transmission (CDT) and large cross-polarization ratio (CPR) in transmitted light to exhibit spin-controlled wavefront shaping capabilities. The chiral geometric metasurfaces are constructed by merging two independently designed subarrays of the two enantiomers for the stepped nanoaperture. Under a certain incident handedness, the transmission from one subarray is allowed, while the transmission from the other subarray is strongly prohibited. The merged metasurface then only exhibits the transmitted signal with the phase profile of one subarray, which can be switched by changing the incident handedness. Based on the chiralmore »geometric metasurface, both chiral metasurface holograms and the spin-dependent generation of hybrid-order Poincaré sphere beams are experimentally realized. Our approach promises further applications in spin-controlled metasurface devices for complex beam conversion, image processing, optical trapping, and optical communications.

    « less
  2. Abstract The ability to engineer the spatial wavefunction of photons has enabled a variety of quantum protocols for communication, sensing, and information processing. These protocols exploit the high dimensionality of structured light enabling the encoding of multiple bits of information in a single photon, the measurement of small physical parameters, and the achievement of unprecedented levels of security in schemes for cryptography. Unfortunately, the potential of structured light has been restrained to free-space platforms in which the spatial profile of photons is preserved. Here, we make an important step forward to using structured light for fiber optical communication. We introduce a classical encryption protocol in which the propagation of high-dimensional spatial modes in multimode fibers is used as a natural mechanism for encryption. This provides a secure communication channel for data transmission. The information encoded in spatial modes is retrieved using artificial neural networks, which are trained from the intensity distributions of experimentally detected spatial modes. Our on-fiber communication platform allows us to use single spatial modes for information encoding as well as the high-dimensional superposition modes for bit-by-bit and byte-by-byte encoding respectively. This protocol enables one to recover messages and images with almost perfect accuracy. Our classical smart protocolmore »for high-dimensional encryption in optical fibers provides a platform that can be adapted to address increased per-photon information capacity at the quantum level, while maintaining the fidelity of information transfer. This is key for quantum technologies relying on structured fields of light, particularly those that are challenged by free-space propagation.« less
  3. Abstract

    There remains a critical need for large‐area imaging technologies that operate in the shortwave infrared spectral region. Upconversion imagers that combine photo‐sensing and display in a compact structure are attractive since they avoid the costly and complex process of pixilation. However, upconversion device research is primarily focused on the optical output, while electronic signals from the imager remain underutilized. Here, an organic upconversion imager that is efficient in both optical and electronic readouts, extending the capability of human and machine vision to 1400 nm, is designed and demonstrated. The imager structure incorporates interfacial layers to suppress non‐radiative recombination and provide enhanced optical upconversion efficiency and electronic detectivity. The photoresponse is comparable to state‐of‐the‐art organic infrared photodiodes exhibiting a high external quantum efficiency of ≤35% at a low bias of ≤3 V and 3 dB bandwidth of 10 kHz. The large active area of 2 cm2enables demonstrations such as object inspection, imaging through smog, and concurrent recording of blood vessel location and blood flow pulses. These examples showcase the potential of the authors’ dual‐readout imager to directly upconvert infrared light for human visual perception and simultaneously yield electronic signals for automated monitoring applications.

  4. This review focuses on the control over the degrees of freedom (DOF) in metasurfaces, which include the input DOF (the polarization, wavelength and incident angle of the input light and some dynamic controls), parameter DOF (the complex geometric design of metasurfaces) and output DOF (the phase, polarization and amplitude of the output light). This framework could clearly show us the development process of metasurfaces, from single-functional to multi-functional ones. Advantages of the multi-functional metasurfaces are discussed in the context of various applications, including 3D holography, broadband achromatic metalenses and multi-dimensional encoded information. By combining all the input and output DOF together, we can realize ideal optical meta-devices with deep subwavelength thickness and striking functions beyond the reach of traditional optical components. Moreover, new research directions may emerge when merging different DOF in metasurfaces with other important concepts, such as parity-time symmetry and topology, so that we can have the complete control of light waves in a prescribed manner.
  5. Abstract

    Metasurfaces composed of in‐plane subwavelength nanostructures have unprecedented capability in manipulating the amplitude, phase, and polarization states of light. Here, a unique type of direction‐controlled bifunctional metasurface polarizer is proposed and experimentally demonstrated based on plasmonic stepped slit‐groove dimers. In the forward direction, a chiral linear polarizer is enabled which only allows the transmission of a certain incident handedness and converts it into the specified linear polarization. In the backward direction, the metasurface functions as an anisotropic circular polarizer to selectively convert a certain linear polarization component into the desired circularly polarized transmission. The observed direction‐controlled polarization selection and conversion are explained by the spin‐dependent mode coupling process inside the bilayer structure. Anisotropic chiral imaging based on the proposed metasurface polarizer is further demonstrated. The results provide new degrees of freedom to realize future multifunctional photonic integrated devices for structured light conversion, vector beam generation, optical imaging and sensing, and optical communication.