skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Stochastic Light Field Holography
The Visual Turing Test is the ultimate goal to evaluate the realism of holographic displays. Previous studies have focused on addressing challenges such as limited e ́tendue and image quality over a large focal volume, but they have not investigated the effect of pupil sampling on the viewing experience in full 3D holograms. In this work, we tackle this problem with a novel hologram generation algorithm motivated by matching the projection operators of incoherent (Light Field) and coherent (Wigner Function) light transport. To this end, we supervise hologram computation using synthesized photographs, which are rendered on-the-fly using Light Field refocusing from stochastically sampled pupil states during optimization. The proposed method produces holograms with correct parallax and focus cues, which are important for passing the Visual Turing Test. We validate that our approach compares favorably to state-of-the-art CGH algorithms that use Light Field and Focal Stack supervision. Our experiments demonstrate that our algorithm improves the viewing experience when evaluated under a large variety of different pupil states.  more » « less
Award ID(s):
2107454
PAR ID:
10465406
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
2023 IEEE International Conference on Computational Photography (ICCP)
Page Range / eLocation ID:
1 to 12
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Typical methods to holographically encode arbitrary wavefronts assume the hologram medium only applies either phase shifts or amplitude attenuation to the wavefront. In many cases, phase cannot be introduced to the wavefront without also affecting the amplitude. Here we show how to encode an arbitrary wavefront into an off-axis transmission hologram that returns the exact desired arbitrary wavefunction in a diffracted beam for phase-only, amplitude-only, or mixed phase and amplitude holograms with any periodic groove profile. We apply this to design thin holograms for electrons in a TEM, but our results are generally applicable to light and X-ray optics. We employ a phase reconstruction from a series of focal plane images to qualitatively show the accuracy of this method to impart the expected amplitude and phase to a specific diffraction order. 
    more » « less
  2. Acoustic holographic lenses, also known as acoustic holograms, can change the phase of a transmitted wavefront in order to shape and construct complex ultrasound pressure fields, often for focusing the acoustic energy on a target region. These lenses have been proposed for transcranial focused ultrasound (tFUS) to create diffraction-limited focal zones that target specific brain regions while compensating for skull aberration. Holograms are currently designed using time-reversal approaches in full-wave time-domain numerical simulations. Such simulations need time-consuming computations, which severely limits the adoption of iterative optimization strategies. In the time-reversal method, the number and distribution of virtual sources can significantly influence the final sound field. Because of the computational constraints, predicting these effects and determining the optimal arrangement is challenging. This study introduces an efficient method for designing acoustic holograms using a volumetric holographic technique to generate focused fields inside the skull. The proposed method combines a modified mixed-domain method for ultrasonic propagation with a gradient descent iterative optimization algorithm. The findings are further validated in underwater experiments with a realistic 3D-printed skull phantom. This approach enables substantially faster holographic computation than previously reported techniques. The iterative process uses explicitly defined loss functions to bias the ultrasound field’s optimization parameters to specific desired characteristics, such as axial resolution, transversal resolution, coverage, and focal region uniformity, while eliminating the uncertainty associated with virtual sources in time-reversal techniques. The proposed techniques enable more rapid hologram computation and more flexibility in tailoring ultrasound fields for specific therapeutic requirements. 
    more » « less
  3. null (Ed.)
    There is increasing interest in how the pupil dynamics of the eye reflect underlying cognitive processes and brain states. Problematic, however, is that pupil changes can be due to non-cognitive factors, for example luminance changes in the environment, accommodation and movement. In this paper we consider how by modeling the response of the pupil in real-world environments we can capture the non-cognitive related changes and remove these to extract a residual signal which is a better index of cognition and performance. Specifically, we utilize sequence measures such as fixation position, duration, saccades, and blink-related information as inputs to a deep recurrent neural network (RNN) model for predicting subsequent pupil diameter. We build and evaluate the model for a task where subjects are watching educational videos and subsequently asked questions based on the content. Compared to commonly-used models for this task, the RNN had the lowest errors rates in predicting subsequent pupil dilation given sequence data. Most importantly was how the model output related to subjects' cognitive performance as assessed by a post-viewing test. Consistent with our hypothesis that the model captures non-cognitive pupil dynamics, we found (1) the model's root-mean square error was less for lower performing subjects than for those having better performance on the post-viewing test, (2) the residuals of the RNN (LSTM) model had the highest correlation with subject post-viewing test scores and (3) the residuals had the highest discriminability (assessed via area under the ROC curve, AUC) for classifying high and low test performers, compared to the true pupil size or the RNN model predictions. This suggests that deep learning sequence models may be good for separating components of pupil responses that are linked to luminance and accommodation from those that are linked to cognition and arousal. 
    more » « less
  4. This paper demonstrates the utility of ambient-focal attention and pupil dilation dynamics to describe visual processing of emotional facial expressions. Pupil dilation and focal eye movements reflect deeper cognitive processing and thus shed more light on the dy- namics of emotional expression recognition. Socially anxious in- dividuals (N = 24) and non-anxious controls (N = 24) were asked to recognize emotional facial expressions that gradually morphed from a neutral expression to one of happiness, sadness, or anger in 10-sec animations. Anxious cohorts exhibited more ambient face scanning than their non-anxious counterparts. We observed a positive relationship between focal fixations and pupil dilation, indi- cating deeper processing of viewed faces, but only by non-anxious participants, and only during the last phase of emotion recognition. Group differences in the dynamics of ambient-focal attention sup- port the hypothesis of vigilance to emotional expression processing by socially anxious individuals. We discuss the results by referring to current literature on cognitive psychopathology. 
    more » « less
  5. Holography can offer unique solutions to the specific problems faced by automotive optical systems. Frequently, when possibilities have been exhausted using refractive and refractive designs, diffraction can come to the rescue by opening a new dimension to explore. Holographic optical elements (HOEs), for example, are thin film optics that can advantageously replace lenses, prisms, or mirrors. Head up display (HUD) and LIDAR for autonomous vehicles are two of the systems where our group have used HOEs to provide original answers to the limitations of classical optic. With HUD, HOEs address the problems of the limited field of view, and small eye box usually found in projection systems. Our approach is to recycle the light multiple times inside a waveguide so the combiner can be as large as the entire windshield. In this system, a hologram is used to inject a small image at one end of a waveguide, and another hologram is used to extract the image several times, providing an expanded eye box. In the case of LIDAR systems, non-mechanical beam scanning based on diffractive spatial light modulator (SLM), are only able to achieve an angular range of few degrees. We used multiplexed volume holograms (VH) to amplify the initial diffraction angle from the SLM to achieve up to 4π steradian coverage in a compact form factor. 
    more » « less