Augmented reality (AR) devices seek to create compelling visual experiences that merge virtual imagery with the natural world. These devices often rely on wearable near-eye display systems that can optically overlay digital images to the left and right eyes of the user separately. Ideally, the two eyes should be shown images with minimal radiometric differences (e.g., the same overall luminance, contrast, and color in both eyes), but achieving this binocular equality can be challenging in wearable systems with stringent demands on weight and size. Basic vision research has shown that a spectrum of potentially detrimental perceptual effects can be elicited by imagery with radiometric differences between the eyes, but it is not clear whether and how these findings apply to the experience of modern AR devices. In this work, we first develop a testing paradigm for assessing multiple aspects of visual appearance at once, and characterize five key perceptual factors when participants viewed stimuli with interocular contrast differences. In a second experiment, we simulate optical see-through AR imagery using conventional desktop LCD monitors and use the same paradigm to evaluate the multi-faceted perceptual implications when the AR display luminance differs between the two eyes. We also include simulations of monocular AR systems (i.e., systems in which only one eye sees the displayed image). Our results suggest that interocular contrast differences can drive several potentially detrimental perceptual effects in binocular AR systems, such as binocular luster, rivalry, and spurious depth differences. In addition, monocular AR displays tend to have more artifacts than binocular displays with a large contrast difference in the two eyes. A better understanding of the range and likelihood of these perceptual phenomena can help inform design choices that support high-quality user experiences in AR.
more »
« less
Visual Discomfort and Variations in Chromaticity in Art and Nature
Visual discomfort is related to the statistical regularity of visual images. The contribution of luminance contrast to visual discomfort is well understood and can be framed in terms of a theory of efficient coding of natural stimuli, and linked to metabolic demand. While color is important in our interaction with nature, the effect of color on visual discomfort has received less attention. In this study, we build on the established association between visual discomfort and differences in chromaticity across space. We average the local differences in chromaticity in an image and show that this average is a good predictor of visual discomfort from the image. It accounts for part of the variance left unexplained by variations in luminance. We show that the local chromaticity difference in uncomfortable stimuli is high compared to that typical in natural scenes, except in particular infrequent conditions such as the arrangement of colorful fruits against foliage. Overall, our study discloses a new link between visual ecology and discomfort whereby discomfort arises when adaptive perceptual mechanisms are overstimulated by specific classes of stimuli rarely found in nature.
more »
« less
- Award ID(s):
- 1632849
- NSF-PAR ID:
- 10321357
- Date Published:
- Journal Name:
- Frontiers in Neuroscience
- Volume:
- 15
- ISSN:
- 1662-453X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing computational requirements driven by better resolution, refresh rate, and dynamic ranges, all of which reduce the sustained usage time of untethered AR/VR devices. For instance, the Oculus Quest 2, under a fully-charged battery, can sustain only 2 to 3 hours of operation time. Prior display power reduction techniques mostly target smartphone displays. Directly applying smartphone display power reduction techniques, however, degrades the visual perception in AR/VR with noticeable artifacts. For instance, the "power-saving mode" on smartphones uniformly lowers the pixel luminance across the display and, as a result, presents an overall darkened visual perception to users if directly applied to VR content. Our key insight is that VR display power reduction must be cognizant of the gaze-contingent nature of high field-of-view VR displays. To that end, we present a gaze-contingent system that, without degrading luminance, minimizes the display power consumption while preserving high visual fidelity when users actively view immersive video sequences. This is enabled by constructing 1) a gaze-contingent color discrimination model through psychophysical studies, and 2) a display power model (with respect to pixel color) through real-device measurements. Critically, due to the careful design decisions made in constructing the two models, our algorithm is cast as a constrained optimization problem with a closed-form solution, which can be implemented as a real-time, image-space shader. We evaluate our system using a series of psychophysical studies and large-scale analyses on natural images. Experiment results show that our system reduces the display power by as much as 24% (14% on average) with little to no perceptual fidelity degradation.more » « less
-
more » « less
Objective Individuals with migraine exhibit heightened sensitivity to visual input that continues beyond their migraine episodes. However, the contribution of color to visual sensitivity, and how it relates to neural activity, has largely been unexplored in these individuals.
Background Previously, it has been shown that, in non‐migraine individuals, patterns with greater chromaticity separation evoked greater cortical activity, regardless of hue, even when colors were isoluminant. Therefore, to investigate whether individuals with migraine experienced increased visual sensitivity, we compared the behavioral and neural responses to chromatic patterns of increasing separation in migraine and non‐migraine individuals.
Methods Seventeen individuals with migraine (12 with aura) and 18 headache‐free controls viewed pairs of colored horizontal grating patterns that varied in chromaticity separation. Color pairs were either blue‐green, red‐green, or red‐blue. Participants rated the discomfort of the gratings and electroencephalogram was recorded simultaneously.
Results Both groups showed increased discomfort ratings and larger N1/N2 event‐related potentials (ERPs) with greater chromaticity separation, which is consistent with increased cortical excitability. However, individuals with migraine rated gratings as being disproportionately uncomfortable and exhibited greater effects of chromaticity separation in ERP amplitude across occipital and parietal electrodes. Ratings of discomfort and ERPs were smaller in response to the blue‐green color pairs than the red‐green and red‐blue gratings, but this was to an equivalent degree across the 2 groups.
Conclusions Together, these findings indicate that greater chromaticity separation increases neural excitation, and that this effect is heightened in migraine, consistent with the theory that hyper‐excitability of the visual system is a key signature of migraine.
-
Colorimetric sensors offer the prospect for on-demand sensing diagnostics in simple and low-cost form factors, enabling rapid spatiotemporal inspection by digital cameras or the naked eye. However, realizing strong dynamic color variations in response to small changes in sample properties has remained a considerable challenge, which is often pursued through the use of highly responsive materials under broadband illumination. In this work, we demonstrate a general colorimetric sensing technique that overcomes the performance limitations of existing chromatic and luminance-based sensing techniques. Our approach combines structural color optical filters as sensing elements alongside a multichromatic laser illuminant. We experimentally demonstrate our approach in the context of label-free biosensing and achieve ultrasensitive and perceptually enhanced chromatic color changes in response to refractive index changes and small molecule surface attachment. Using structurally enabled chromaticity variations, the human eye is able to resolve ∼0.1-nm spectral shifts with low-quality factor (e.g., Q ∼ 15) structural filters. This enables spatially resolved biosensing in large area (approximately centimeters squared) lithography-free sensing films with a naked eye limit of detection of ∼3 pg/mm 2 , lower than industry standard sensors based on surface plasmon resonance that require spectral or angular interrogation. This work highlights the key roles played by both the choice of illuminant and design of structural color filter, and it offers a promising pathway for colorimetric devices to meet the strong demand for high-performance, rapid, and portable (or point-of-care) diagnostic sensors in applications spanning from biomedicine to environmental/structural monitoring.more » « less
-
Given the dynamic and complex nature of the construction industry, maintaining situation awareness at job sites is critical. To react properly, workers must identify dynamic safety hazards within the scene. The majority of studies assessing construction workers’ situation awareness have utilized static images, virtual reality, and other types of simulation methods, but questions remain as to whether these formats are able to capture and monitor workers’ naturalistic behaviors and hazard identification abilities. To identify whether the format of hazardous stimuli (i.e., static, image-based vs. dynamic, and video-based formats) impact workers’ subjective and objective hazard identification and situation awareness metrics, this study developed 23 safety hazard scenarios utilizing state-of-the-art augmented 360° panoramas and then tracked differences in workers’ visual search patterns and hazard identification abilities using eye-tracking technology. The workers’ cognitive responses, evidenced by their eye movements, showed that workers had significantly varied cognitive processes and abilities depending on the format of stimuli: Workers with lower hazard identification skills were more likely to miss hazards in a dynamic environment. This result suggests that the experimental setting should be carefully designed to determine construction workers’ natural cognitive process.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3389/fnins.2021.711064
