skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Investigating Evoked EEG Responses to Targets Presented in Virtual Reality
Virtual reality (VR) offers the potential to study brain function in complex, ecologically realistic environments. However, the additional degrees of freedom make analysis more challenging, particularly with respect to evoked neural responses. In this paper we designed a target detection task in VR where we varied the visual angle of targets as subjects moved through a three dimensional maze. We investigated how the latency and shape of the classic P300 evoked response varied as a function of locking the electroencephalogram data to the target image onset, the target-saccade intersection, and the first fixation on the target. We found, as expected, a systematic shift in the timing of the evoked responses as a function of the type of response locking, as well as a difference in the shape of the waveforms. Interestingly, single-trial analysis showed that the peak discriminability of the evoked responses does not differ between image locked and saccade locked analysis, though it decreases significantly when fixation locked. These results suggest that there is a spread in the perception of visual information in VR environments across time and visual space. Our results point to the importance of considering how information may be perceived in naturalistic environments, specifically those that have more complexity and higher degrees of freedom than in traditional laboratory paradigms.  more » « less
Award ID(s):
1816363
PAR ID:
10295753
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
Page Range / eLocation ID:
5536 to 5539
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Soft, tip-extending "vine" robots offer a unique mode of inspection and manipulation in highly constrained environments. For practicality, it is desirable that the distal end of the robot can be manipulated freely, while the body remains stationary. However, in previous vine robots, either the shape of the body was fixed after growth with no ability to manipulate the distal end, or the whole body moved together with the tip. Here, we present a concept for shape-locking that enables a vine robot to move only its distal tip, while the body is locked in place. This is achieved using two inextensible, pressurized, tip-extending, chambers that "grow" along the sides of the robot body, preserving curvature in the section where they have been deployed. The length of the locked and free sections can be varied by controlling the extension and retraction of these chambers. We present models describing this shape-locking mechanism and workspace of the robot in both free and constrained environments. We experimentally validate these models, showing an increased dexterous workspace compared to previous vine robots. Our shape-locking concept allows improved performance for vine robots, advancing the field of soft robotics for inspection and manipulation in highly constrained environments. 
    more » « less
  2. Vigilance refers to an individual’s ability to maintain attention over time. Vigilance decrement is particularly concerning in clinical environments where shift work and long working hours are common. This study identifies significant factors and indicators for predicting and monitoring individuals’ vigilance decrement. We enrolled 11 participants and measured their vigilance levels by recording their reaction times while completing the Psychomotor Vigilance Test. Additionally, we measured participants’ physiological responses and collected their sleep deprivation data, demographic information, and self-reported anxiety levels. Using repeated-measures correlation analysis, we found that decreased vigilance levels, indicated by longer reaction times, were associated with higher electrodermal activity ( p < .01), lower skin temperature ( p < .001), shorter fixation durations ( p < .05), and increased saccade frequency ( p < .05). Moreover, sleep deprivation significantly affected vigilance decrement ( p < .001). Our findings provide the potential to develop a predictive model of vigilance decrements using physiological signals collected from non-intrusive devices, as an alternative to current behavior-based methods. 
    more » « less
  3. Theories of reading posit that decisions about “where” and “when” to move the eyes are driven by visual and linguistic factors, extracted from the perceptual span and word identification span, respectively. We tested this hypothesized dissociation by masking, outside of a visible window, either the spaces between the words (to assess the perceptual span, Experiment 1) or the letters within the words (to assess the word identification span, Experiment 2). We also investigated whether deaf readers’ previously reported larger reading span was specifically linked to one of these spans. We analyzed reading rate to test overall reading efficiency, as well as average saccade length to test “where” decisions and average fixation duration to test “when” decisions. Both hearing and deaf readers’ perceptual spans extended between 10 and 14 characters, and their word identification spans extended to eight characters to the right of fixation. Despite similar sized rightward spans, deaf readers read more efficiently overall and showed a larger increase in reading rate when leftward text was available, suggesting they attend more to leftward information. Neither rightward span was specifically related to where or when decisions for either group. Our results challenge the assumed dissociation between type of reading span and type of saccade decision and indicate that reading efficiency requires access to both perceptual and linguistic information in the parafovea. 
    more » « less
  4. Abstract Mimicry is a biological camouflage phenomenon whereby an organism can change its shape and color to resemble another object. Herein, the idea of biological mimicry and rich degrees of freedom in metasurface designs are combined to realize holographic mimicry devices. A general mathematical method, called phase matrix transformation, to accomplish the holographic mimicry process is proposed. Based on this method, a dynamic metasurface hologram is designed, which shows an image of a “bird” in the air, and a distinct image of a “fish” when the environment is changed to oil. Furthermore, to make the mimicry behavior more generic, holographic mimicry operating at dual wavelengths is also designed and experimentally demonstrated. Moreover, the fully independent phase modulation realized by phase matrix transformation makes the working efficiency of the device relatively higher than the conventional multiwavelength holographic devices with off‐axis illumination or interleaved subarrays. The work potentially opens a new research paradigm interfacing bionics with nanophotonics, which may produce novel applications for optical information encryption, virtual/augmented reality (VR/AR), and military camouflage systems. 
    more » « less
  5. Reading is a highly complex learned skill in which humans move their eyes three to four times every second in response to visual and cognitive processing. The consensus view is that the details of these rapid eye-movement decisions—which part of a word to target with a saccade—are determined solely by low-level oculomotor heuristics. But maximally efficient saccade targeting would be sensitive to ongoing word identification, sending the eyes farther into a word the farther its identification has already progressed. Here, using a covert text-shifting paradigm, we showed just such a statistical relationship between saccade targeting in reading and trial-to-trial variability in cognitive processing. This result suggests that, rather than relying purely on heuristics, the human brain has learned to optimize eye movements in reading even at the fine-grained level of character-position targeting, reflecting efficiency-based sensitivity to ongoing cognitive processing. 
    more » « less