An official website of the United States government
Stationarity perception refers to the ability to accurately perceive the surrounding visual environment as world-fixed during self-motion. Perception of stationarity depends on mechanisms that evaluate the congruence between retinal/oculomotor signals and head movement signals. In a series of psychophysical experiments, we systematically varied the congruence between retinal/oculomotor and head movement signals to find the range of visual gains that is compatible with perception of a stationary environment. On each trial, human subjects wearing a head-mounted display execute a yaw head movement and report whether the visual gain was perceived to be too slow or fast. A psychometric fit to the data across trials reveals the visual gain most compatible with stationarity (a measure of accuracy) and the sensitivity to visual gain manipulation (a measure of precision). Across experiments, we varied 1) the spatial frequency of the visual stimulus, 2) the retinal location of the visual stimulus (central vs. peripheral), and 3) fixation behavior (scene-fixed vs. head-fixed). Stationarity perception is most precise and accurate during scene-fixed fixation. Effects of spatial frequency and retinal stimulus location become evident during head-fixed fixation, when retinal image motion is increased. Virtual Reality sickness assessed using the Simulator Sickness Questionnaire covaries with perceptual performance. Decreased accuracy is associated with an increase in the nausea subscore, while decreased precision is associated with an increase in the oculomotor and disorientation subscores.
more »
« less
Motor Signals Mediate Stationarity Perception
Abstract Head movement relative to the stationary environment gives rise to congruent vestibular and visual optic-flow signals. The resulting perception of a stationary visual environment, referred to herein as stationarity perception, depends on mechanisms that compare visual and vestibular signals to evaluate their congruence. Here we investigate the functioning of these mechanisms and their dependence on fixation behavior as well as on the activeversuspassive nature of the head movement. Stationarity perception was measured by modifying the gain on visual motion relative to head movement on individual trials and asking subjects to report whether the gain was too low or too high. Fitting a psychometric function to the data yields two key parameters of performance. The mean is a measure of accuracy, and the standard deviation is a measure of precision. Experiments were conducted using a head-mounted display with fixation behavior monitored by an embedded eye tracker. During active conditions, subjects rotated their heads in yaw ∼15 deg/s over ∼1 s. Each subject’s movements were recorded and played backviarotating chair during the passive condition. During head-fixed and scene-fixed fixation the fixation target moved with the head or scene, respectively. Both precision and accuracy were better during active than passive head movement, likely due to increased precision on the head movement estimate arising from motor prediction and neck proprioception. Performance was also better during scene-fixed than head-fixed fixation, perhaps due to decreased velocity of retinal image motion and increased precision on the retinal image motion estimate. These results reveal how the nature of head and eye movements mediate encoding, processing, and comparison of relevant sensory and motor signals.
more »
« less
- Award ID(s):
- 1911041
- PAR ID:
- 10482175
- Publisher / Repository:
- Brill
- Date Published:
- Journal Name:
- Multisensory Research
- Volume:
- 36
- Issue:
- 7
- ISSN:
- 2213-4794
- Page Range / eLocation ID:
- 703 to 724
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Scientists have pondered the perceptual effects of ocular motion, and those of its counterpart, ocular stillness, for over 200 years. The unremitting ‘trembling of the eye’ that occurs even during gaze fixation was first noted by Jurin in 1738. In 1794, Erasmus Darwin documented that gaze fixation produces perceptual fading, a phenomenon rediscovered in 1804 by Ignaz Paul Vital Troxler. Studies in the twentieth century established that Jurin's ‘eye trembling’ consisted of three main types of ‘fixational’ eye movements, now called microsaccades (or fixational saccades), drifts and tremor. Yet, owing to the constant and minute nature of these motions, the study of their perceptual and physiological consequences has met significant technological challenges. Studies starting in the 1950s and continuing in the present have attempted to study vision during retinal stabilization—a technique that consists on shifting any and all visual stimuli presented to the eye in such a way as to nullify all concurrent eye movements—providing a tantalizing glimpse of vision in the absence of change. No research to date has achieved perfect retinal stabilization, however, and so other work has devised substitute ways to counteract eye motion, such as by studying the perception of afterimages or of the entoptic images formed by retinal vessels, which are completely stable with respect to the eye. Yet other research has taken the alternative tack to control eye motion by behavioural instruction to fix one's gaze or to keep one's gaze still, during concurrent physiological and/or psychophysical measurements. Here, we review the existing data—from historical and contemporary studies that have aimed to nullify or minimize eye motion—on the perceptual and physiological consequences of perfect versus imperfect fixation. We also discuss the accuracy, quality and stability of ocular fixation, and the bottom–up and top–down influences that affect fixation behaviour. This article is part of the themed issue ‘Movement suppression: brain mechanisms for stopping and stillness’.more » « less
-
Objective: To determine if a vestibular prosthesis could improve function in subjects with severe vestibular damage and could be used it as a scientific tool to investigate central vestibular processing. Background: Damage to the vestibular labyrinth is common and usually permanent. We therefore developed and tested a vestibular implant (VI) that is designed to mimic the information normally provided by the vestibular labyrinth to determine if we can reduce vestibular-mediated deficits and study temporal integration of sensory cues in the brain. Design/Methods: Monkeys had electrodes implanted in the semicircular canals of one ear and then severe bilateral vestibular damage was induced with aminoglycosides. Eye movements, perception, and balance were tested before and after vestibular damage and with the VI activated, which supplied head motion information to the brain via electrical stimulation delivered by the implanted electrodes. Humans also had electrode implantation (done in conjunction with a cochlear implant, CI) and they were tested on a temporal binding psychophysical task Results: Stimulation provided by VI in vestibulopathic monkeys improved their balance, perception of spatial orientation, and eye movement responses. Timing experiments in humans using CI and VI stimuli showed that unlike past experiments that used motion to generate the vestibular signal, CI and VI signals were received by the cerebral cortex with the same latency and were perceived as simultaneous, but this timing perception was highly sensitive to adaption. Conclusions: VI improves oculomotor, postural, and perceptual behavior in vestibulopathic monkeys and could prove to be an effective way to improve these functions in patients with permanent labyrinthine damage. Timing experiments show that when novel stimuli are used, the brain synthesizes them in accordance with their arrival at the cortex, but that experience can rapidly recalibrate this timing relationship, which may be why normal stimuli that are experienced habitually lack this characteristic.more » « less
-
Virtual reality sickness typically results from visual-vestibular conflict. Because self-motion from optical flow is driven most strongly by motion at the periphery of the retina, reducing the user’s field-of-view (FOV) during locomotion has proven to be an effective strategy to minimize visual vestibular conflict and VR sickness. Current FOV restrictor implementations reduce the user’s FOV by rendering a restrictor whose center is fixed at the center of the head mounted display (HMD), which is effective when the user’s eye gaze is aligned with head gaze. However, during eccentric eye gaze, users may look at the FOV restrictor itself, exposing them to peripheral optical flow which could lead to increased VR sickness. To address these limitations, we develop a foveated FOV restrictor and we explore the effect of dynamically moving the center of the FOV restrictor according to the user’s eye gaze position. We conducted a user study (n=22) where each participant uses a foveated FOV restrictor and a head-fixed FOV restrictor while navigating a virtual environment. We found no statistically significant difference in VR sickness measures or noticeability between both restrictors. However, there was a significant difference in eye gaze behavior, as measured by eye gaze dispersion, with the foveated FOV restrictor allowing participants to have a wider visual scan area compared to the head-fixed FOV restrictor, which confined their eye gaze to the center of the FOV.more » « less
-
Summary Many animals rely on vision to navigate through their environment. The pattern of changes in the visual scene induced by self-motion is theoptic flow1, which is first estimated in local patches by directionally selective (DS) neurons2–4. But how should the arrays of DS neurons, each responsive to motion in a preferred direction at a specific retinal position, be organized to support robust decoding of optic flow by downstream circuits? Understanding this global organization is challenging because it requires mapping fine, local features of neurons across the animal’s field of view3. InDrosophila, the asymmetric dendrites of the T4 and T5 DS neurons establish their preferred direction, making it possible to predict DS responses from anatomy4,5. Here we report that the preferred directions of fly DS neurons vary at different retinal positions and show that this spatial variation is established by the anatomy of the compound eye. To estimate the preferred directions across the visual field, we reconstructed hundreds of T4 neurons in a full brain EM volume6and discovered unexpectedly stereotypical dendritic arborizations that are independent of location. We then used whole-head μCT scans to map the viewing directions of all compound eye facets and found a non-uniform sampling of visual space that explains the spatial variation in preferred directions. Our findings show that the organization of preferred directions in the fly is largely determined by the compound eye, exposing an intimate and unexpected connection between the peripheral structure of the eye, functional properties of neurons deep in the brain, and the control of body movements.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1163/22134808-bja10111
