An official website of the United States government
Machine learning with artificial neural networks has recently transformed many scientific fields by introducing new data analysis and information processing techniques. Despite these advancements, efficient implementation of machine learning on conventional computers remains challenging due to speed and power constraints. Optical computing schemes have quickly emerged as the leading candidate for replacing their electronic counterparts as the backbone for artificial neural networks. Some early integrated photonic neural network (IPNN) techniques have already been fast-tracked to industrial technologies. This review article focuses on the next generation of optical neural networks (ONNs), which can perform machine learning algorithms directly in free space. We have aptly named this class of neural network model the free space optical neural network (FSONN). We systematically compare FSONNs, IPNNs, and the traditional machine learning models with regard to their fundamental principles, forward propagation model, and training process. We survey several broad classes of FSONNs and categorize them based on the technology used in their hidden layers. These technologies include 3D printed layers, dielectric and plasmonic metasurface layers, and spatial light modulators. Finally, we summarize the current state of FSONN research and provide a roadmap for its future development.
more »
« less
An Optical Neural Network Based on Nanophotonic Optical Parametric Oscillators
We experimentally demonstrate a recurrent optical neural network based on a nanophotonic optical parametric oscillator fabricated on thin-film lithium niobate. Our demonstration paves the way for realizing optical neural networks exhibiting ultra-low la-tencies.
more »
« less
- Award ID(s):
- 1846273
- PAR ID:
- 10544729
- Publisher / Repository:
- Optica Publishing Group
- Date Published:
- ISBN:
- 978-1-957171-39-5
- Page Range / eLocation ID:
- STu3P.7
- Format(s):
- Medium: X
- Location:
- Charlotte, North Carolina
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Deep learning has become a widespread tool in both science and industry. However, continued progress is hampered by the rapid growth in energy costs of ever-larger deep neural networks. Optical neural networks provide a potential means to solve the energy-cost problem faced by deep learning. Here, we experimentally demonstrate an optical neural network based on optical dot products that achieves 99% accuracy on handwritten-digit classification using ~3.1 detected photons per weight multiplication and ~90% accuracy using ~0.66 photons (~2.5 × 10 −19 J of optical energy) per weight multiplication. The fundamental principle enabling our sub-photon-per-multiplication demonstration—noise reduction from the accumulation of scalar multiplications in dot-product sums—is applicable to many different optical-neural-network architectures. Our work shows that optical neural networks can achieve accurate results using extremely low optical energies.more » « less
-
Abstract Neural interfaces bridge the nervous system and the outside world by recording and stimulating neurons. Combining electrical and optical modalities in a single, hybrid neural interface system could lead to complementary and powerful new ways to explore the brain. This convergent approach has gained robust and exciting momentum recently in neuroscience and neural engineering research. Here, we review developments in the past several years aiming to achieve such hybrid electrical and optical microsystem platforms. Specifically, we cover three major categories of technological advances: transparent neuroelectrodes, optical neural fibers with electrodes, and neural probes/grids integrating electrodes and microscale light-emitting diodes. We analyze examples of these probes tailored to combine electrophysiological recording with optical imaging or optical stimulation of the brain and discuss possible directions of future innovation.more » « less
-
Abstract Diffractive optical neural networks have shown promising advantages over electronic circuits for accelerating modern machine learning (ML) algorithms. However, it is challenging to achieve fully programmable all‐optical implementation and rapid hardware deployment. Here, a large‐scale, cost‐effective, complex‐valued, and reconfigurable diffractive all‐optical neural networks system in the visible range is demonstrated based on cascaded transmissive twisted nematic liquid crystal spatial light modulators. The employment of categorical reparameterization technique creates a physics‐aware training framework for the fast and accurate deployment of computer‐trained models onto optical hardware. Such a full stack of hardware and software enables not only the experimental demonstration of classifying handwritten digits in standard datasets, but also theoretical analysis and experimental verification of physics‐aware adversarial attacks onto the system, which are generated from a complex‐valued gradient‐based algorithm. The detailed adversarial robustness comparison with conventional multiple layer perceptrons and convolutional neural networks features a distinct statistical adversarial property in diffractive optical neural networks. The developed full stack of software and hardware provides new opportunities of employing diffractive optics in a variety of ML tasks and in the research on optical adversarial ML.more » « less
-
Abstract Free‐space optical systems are emerging as a hardware platform for high‐throughput and energy‐efficient computing. In this review, the pioneering works are first introduced to lay the foundation for the principles and architectures of systems. The modern hardware implementations of two types of optical computing systems, matrix, and vector multiplication systems and diffractive optical neural network systems, are covered from material, device, and system perspectives. Further, the system deployment to various applications is also discussed. This review serves as an introduction and guideline to the current progress of developing and utilizing free‐space optical computing systems in various domains.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1364/CLEO_SI.2024.STu3P.7
