The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited e ́tendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algorithm motivated by matching the projection operators of incoherent (Light Field) and coherent (Wigner Function) light transport. To this end, we supervise hologram computation using synthesized photographs, which are rendered on-the-fly using Light Field refocusing from stochastically sampled pupil states during optimization. The proposed method produces holograms with correct parallax and focus cues, which are important for passing the Visual Turing Test. We validate that our approach compares favorably to state-of-the-art CGH algorithms that use Light Field and Focal Stack supervision. Our experiments demonstrate that our algorithm improves the viewing experience when evaluated under a large variety of different pupil states.
more »
« less
Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration
Computer-generated holography (CGH) holds transformative potential for a wide range of applications, including direct-view, virtual and augmented reality, and automotive display systems. While research on holographic displays has recently made impressive progress, image quality and eye safety of holographic displays are fundamentally limited by the speckle introduced by coherent light sources. Here, we develop an approach to CGH using partially coherent sources. For this purpose, we devise a wave propagation model for partially coherent light that is demonstrated in conjunction with a camera-in-the-loop calibration strategy. We evaluate this algorithm using light-emitting diodes (LEDs) and superluminescent LEDs (SLEDs) and demonstrate improved speckle characteristics of the resulting holograms compared with coherent lasers. SLEDs in particular are demonstrated to be promising light sources for holographic display applications, because of their potential to generate sharp and high-contrast two-dimensional (2D) and 3D images that are bright, eye safe, and almost free of speckle.
more »
« less
- Award ID(s):
- 1839974
- NSF-PAR ID:
- 10353641
- Date Published:
- Journal Name:
- Science Advances
- Volume:
- 7
- Issue:
- 46
- ISSN:
- 2375-2548
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Background Opsin‐based optogenetics has emerged as a powerful biomedical tool using light to control protein conformation. Such capacity has been initially demonstrated to control ion flow across the cell membrane, enabling precise control of action potential in excitable cells such as neurons or muscle cells. Further advancement in optogenetics incorporates a greater variety of photoactivatable proteins and results in flexible control of biological processes, such as gene expression and signal transduction, with commonly employed light sources such as LEDs or lasers in optical microscopy. Blessed by the precise genetic targeting specificity and superior spatiotemporal resolution, optogenetics offers new biological insights into physiological and pathological mechanisms underlying health and diseases. Recently, its clinical potential has started to be capitalized, particularly for blindness treatment, due to the convenient light delivery into the eye.
Aims and methods This work summarizes the progress of current clinical trials and provides a brief overview of basic structures and photophysics of commonly used photoactivable proteins. We highlight recent achievements such as optogenetic control of the chimeric antigen receptor, CRISPR‐Cas system, gene expression, and organelle dynamics. We discuss conceptual innovation and technical challenges faced by current optogenetic research.
Conclusion In doing so, we provide a framework that showcases ever‐growing applications of optogenetics in biomedical research and may inform novel precise medicine strategies based on this enabling technology.
-
Holographic displays promise to deliver unprecedented display capabilities in augmented reality applications, featuring a wide field of view, wide color gamut, spatial resolution, and depth cues all in a compact form factor. While emerging holographic display approaches have been successful in achieving large étendue and high image quality as seen by a camera, the large étendue also reveals a problem that makes existing displays impractical: the sampling of the holographic field by the eye pupil. Existing methods have not investigated this issue due to the lack of displays with large enough étendue, and, as such, they suffer from severe artifacts with varying eye pupil size and location. We show that the holographic field as sampled by the eye pupil is highly varying for existing display setups, and we propose pupil-aware holography that maximizes the perceptual image quality irrespective of the size, location, and orientation of the eye pupil in a near-eye holographic display. We validate the proposed approach both in simulations and on a prototype holographic display and show that our method eliminates severe artifacts and significantly outperforms existing approaches.more » « less
-
more » « less
We present a foveated rendering method to accelerate the amplitude-only computer-generated hologram (AO-CGH) calculation in a holographic near-eye 3D display. For a given target image, we compute a high-resolution foveal region and a low-resolution peripheral region with dramatically reduced pixel numbers. Our technique significantly improves the computation speed of the AO-CGH while maintaining the perceived image quality in the fovea. Moreover, to accommodate the eye gaze angle change, we develop an algorithm to laterally shift the foveal image with negligible extra computational cost. Our technique holds great promise in advancing the holographic 3D display in real-time use.
-
more » « less
Abstract Emissive displays based on light‐emitting diodes (LEDs), with high pixel density, luminance, efficiency, and large color gamut, are of great interest for applications such as watches, phones, and virtual displays. The high pixel density requirements of some emissive displays require a particular class of LEDs that are sub‐20‐micrometers in length, called micro‐LEDs. While state‐of‐the‐art emissive displays incorporate organic LEDs, an alternative is inorganic III‐nitride LEDs with potential reliability and efficiency benefits. Here we explore the performance, challenges, and prospective outcomes for III‐nitride micro‐LEDs to produce efficient emissive displays and provide insight to advance this technology. Calculations are performed to determine the operating points for the micro‐LEDs and the efficiency of the overall emissive display. It is shown that III‐nitride micro‐LEDs suffer from some of the same problems as their larger‐sized solid‐state lighting LED cousins; however, the operating conditions of micro‐LEDs can result in different challenges and research efforts. These challenges include improving efficiency at low current densities; improving the efficiency of longer wavelength (green and red) LEDs; and creating device designs that can overcome low coupling efficiency, high surface recombination, and display assembly difficulties.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1126/sciadv.abg5040
