Event cameras, which feature pixels that independently respond to changes in brightness, are becoming increasingly popular in high- speed applications due to their lower latency, reduced bandwidth requirements, and enhanced dynamic range compared to traditional frame- based cameras. Numerous imaging and vision techniques have leveraged event cameras for high- speed scene understanding by capturing high- framerate, high- dynamic range videos, primarily utilizing the temporal advantages inherent to event cameras. Additionally, imaging and vision techniques have utilized the light field—a complementary dimension to temporal information—for enhanced scene understanding.In this work, we propose "Event Fields", a new approach that utilizes innovative optical designs for event cameras to capture light fields at high speed. We develop the underlying mathematical framework for Event Fields and introduce two foundational frameworks to capture them practically: spatial multiplexing to capture temporal derivatives and temporal multiplexing to capture angular derivatives. To realize these, we design two complementary optical setups— one using a kaleidoscope for spatial multiplexing and another using a galvanometer for temporal multiplexing. We evaluate the performance of both designs using a custom-built simulator and real hardware prototypes, showcasing their distinct benefits. Our event fields unlock the full advantages of typical light fields—like post- capture refocusing and depth estimation—now supercharged for high- speed and high- dynamic range scenes. This novel light- sensing paradigm opens doors to new applications in photography, robotics, and AR/VR, and presents fresh challenges in rendering and machine learning.
more »
« less
Pixel level demonstration of phase change material based spatial light modulation
We present an advancement towards high speed (sub ps) phase change material based spatial light modulators by electrically addressing single pixels with high-speed optical monitoring at 1550nm light.
more »
« less
- Award ID(s):
- 1710273
- PAR ID:
- 10303769
- Date Published:
- Journal Name:
- Conference on Lasers and Electro-Optics
- Volume:
- 2020
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
High-precision light manipulation is crucial for delivering information through complex media. However, existing spatial light modulation devices face a fundamental speed-fidelity tradeoff. Digital micromirror devices have emerged as a promising candidate for high-speed wavefront shaping but at the cost of compromised fidelity due to the limited control degrees of freedom. Here, we leverage the sparse-to-random transformation through complex media to overcome the dimensionality limitation of spatial light modulation devices. We demonstrate that pattern compression by sparsity-constrained wavefront optimization allows sparse and robust wavefront representations in complex media, improving the projection fidelity without sacrificing frame rate, hardware complexity, or optimization time. Our method is generalizable to different pattern types and complex media, supporting consistent performance with up to 89% and 126% improvements in projection accuracy and speckle suppression, respectively. The proposed optimization framework could enable high-fidelity high-speed wavefront shaping through different scattering media and platforms without changes to the existing holographic setups, facilitating a wide range of physics and real-world applications.more » « less
-
null (Ed.)We demonstrate a technique for measuring the full-speed performance of integrated modulators from ultraweak surface-coupled and scattered light. This can enable rapid characterization of unpackaged, high-speed wafer-scale integrated photonics without test ports or special fabrication.more » « less
-
A coherent multi-dimensional photonic tensor accelerator performing high-speed matrix-matrix multiplication is proposed and demonstrated. A pattern recognition experiment is demonstrated at a 25Gbps modulation speed exploiting orthogonal dimensions of light including time, wavelength, and spatial mode.more » « less
-
null (Ed.)Visible wavelength data communication is of interest for short distance chip-to-chip interconnects and free-space links such as Li-Fi, where modulated sources are incorporated in lighting systems. For the former, both high modulation bandwidth and low power consumption are critical. At Avicena, we have developed efficient high-speed light-emitting structures capable of multi-Gb/s NRZ modulation, which operate down to a few microamps of drive current. We have demonstrated a high speed and low energy optical communication links using these novel devices.more » « less
An official website of the United States government

