Abstract Recent remarkable progress in artificial intelligence (AI) has garnered tremendous attention from researchers, industry leaders, and the general public, who are increasingly aware of AI's growing impact on everyday life. The advancements of AI and deep learning have also significantly influenced the field of nanophotonics. On the one hand, deep learning facilitates data‐driven strategies for optimizing and solving forward and inverse problems of nanophotonic devices. On the other hand, photonic devices offer promising optical platforms for implementing deep neural networks. This review explores both AI for photonic design and photonic implementation of AI. Various deep learning models and their roles in the design of photonic devices are introduced, analyzing the strengths and challenges of these data‐driven methodologies from the perspective of computational cost. Additionally, the potential of optical hardware accelerators for neural networks is discussed by presenting a variety of photonic devices capable of performing linear and nonlinear operations, essential building blocks of neural networks. It is believed that the bidirectional interactions between nanophotonics and AI will drive the coevolution of these two research fields.
more »
« less
All-optical ultrafast ReLU function for energy-efficient nanophotonic deep learning
Abstract In recent years, the computational demands of deep learning applications have necessitated the introduction of energy-efficient hardware accelerators. Optical neural networks are a promising option; however, thus far they have been largely limited by the lack of energy-efficient nonlinear optical functions. Here, we experimentally demonstrate an all-optical Rectified Linear Unit (ReLU), which is the most widely used nonlinear activation function for deep learning, using a periodically-poled thin-film lithium niobate nanophotonic waveguide and achieve ultra-low energies in the regime of femtojoules per activation with near-instantaneous operation. Our results provide a clear and practical path towards truly all-optical, energy-efficient nanophotonic deep learning.
more »
« less
- PAR ID:
- 10328813
- Date Published:
- Journal Name:
- Nanophotonics
- Volume:
- 0
- Issue:
- 0
- ISSN:
- 2192-8606
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The explosive growth in computation and energy cost of artificial intelligence has spurred interest in alternative computing modalities to conventional electronic processors. Photonic processors, which use photons instead of electrons, promise optical neural networks with ultralow latency and power consumption. However, existing optical neural networks, limited by their designs, have not achieved the recognition accuracy of modern electronic neural networks. In this work, we bridge this gap by embedding parallelized optical computation into flat camera optics that perform neural network computations during capture, before recording on the sensor. We leverage large kernels and propose a spatially varying convolutional network learned through a low-dimensional reparameterization. We instantiate this network inside the camera lens with a nanophotonic array with angle-dependent responses. Combined with a lightweight electronic back-end of about 2K parameters, our reconfigurable nanophotonic neural network achieves 72.76% accuracy on CIFAR-10, surpassing AlexNet (72.64%), and advancing optical neural networks into the deep learning era.more » « less
-
Abstract Nonlinear optics plays an important role in many areas of science and technology. The advance of nonlinear optics is empowered by the discovery and utilization of materials with growing optical nonlinearity. Here we demonstrate an indium gallium phosphide (InGaP) integrated photonics platform for broadband, ultra-efficient second-order nonlinear optics. The InGaP nanophotonic waveguide enables second-harmonic generation with a normalized efficiency of 128, 000%/W/cm2at 1.55μm pump wavelength, nearly two orders of magnitude higher than the state of the art in the telecommunication C band. Further, we realize an ultra-bright, broadband time-energy entangled photon source with a pair generation rate of 97 GHz/mW and a bandwidth of 115 nm centered at the telecommunication C band. The InGaP entangled photon source shows high coincidence-to-accidental counts ratio CAR > 104and two-photon interference visibility > 98%. The InGaP second-order nonlinear photonics platform will have wide-ranging implications for non-classical light generation, optical signal processing, and quantum networking.more » « less
-
Abstract The exponential growth of information stored in data centers and computational power required for various data-intensive applications, such as deep learning and AI, call for new strategies to improve or move beyond the traditional von Neumann architecture. Recent achievements in information storage and computation in the optical domain, enabling energy-efficient, fast, and high-bandwidth data processing, show great potential for photonics to overcome the von Neumann bottleneck and reduce the energy wasted to Joule heating. Optically readable memories are fundamental in this process, and while light-based storage has traditionally (and commercially) employed free-space optics, recent developments in photonic integrated circuits (PICs) and optical nano-materials have opened the doors to new opportunities on-chip. Photonic memories have yet to rival their electronic digital counterparts in storage density; however, their inherent analog nature and ultrahigh bandwidth make them ideal for unconventional computing strategies. Here, we review emerging nanophotonic devices that possess memory capabilities by elaborating on their tunable mechanisms and evaluating them in terms of scalability and device performance. Moreover, we discuss the progress on large-scale architectures for photonic memory arrays and optical computing primarily based on memory performance.more » « less
-
Nonlinear photonic circuits with the ability to generate and process signals all-optically have emerged in the past decade with superior performance to electronic chips. In particular, crystalline silicon has become a leading platform for integrated nonlinear optics. More recently, hydrogenated amorphous silicon emerged as a promising alternative to crystalline silicon due to its large nonlinearity. In this paper, we review recent research on nonlinear optical interactions in and applications of hydrogenated amorphous silicon nanophotonic devices. This new material platform enables the capability of multilayer CMOS-compatible photonic integrated circuits with low power requirements for high-speed optical signal processing.more » « less
An official website of the United States government

