Virtual reality sickness typically results from visual-vestibular conflict. Because self-motion from optical flow is driven most strongly by motion at the periphery of the retina, reducing the user’s field-of-view (FOV) during locomotion has proven to be an effective strategy to minimize visual vestibular conflict and VR sickness. Current FOV restrictor implementations reduce the user’s FOV by rendering a restrictor whose center is fixed at the center of the head mounted display (HMD), which is effective when the user’s eye gaze is aligned with head gaze. However, during eccentric eye gaze, users may look at the FOV restrictor itself, exposing them to peripheral optical flow which could lead to increased VR sickness. To address these limitations, we develop a foveated FOV restrictor and we explore the effect of dynamically moving the center of the FOV restrictor according to the user’s eye gaze position. We conducted a user study (n=22) where each participant uses a foveated FOV restrictor and a head-fixed FOV restrictor while navigating a virtual environment. We found no statistically significant difference in VR sickness measures or noticeability between both restrictors. However, there was a significant difference in eye gaze behavior, as measured by eye gaze dispersion, with the foveated FOV restrictor allowing participants to have a wider visual scan area compared to the head-fixed FOV restrictor, which confined their eye gaze to the center of the FOV.
more »
« less
Full field-of-view virtual reality goggles for mice
Visual virtual reality (VR) systems for head-fixed mice offer advantages over real-world studies for investigating the neural circuitry underlying behavior. However, current VR approaches do not fully cover the visual field of view of mice, do not stereoscopically illuminate the binocular zone, and leave the lab frame visible. To overcome these limitations, we developed iMRSIV (Miniature Rodent Stereo Illumination VR)—VR goggles for mice. Our system is compact, separately illuminates each eye for stereo vision, and provides each eye with an ∼180° field of view, thus excluding the lab frame while accommodating saccades. Mice using iMRSIV while navigating engaged in virtual behaviors more quickly than in a current monitor-based system and displayed freezing and fleeing reactions to overhead looming stimulation. Using iMRSIV with two-photon functional imaging, we found large populations of hippocampal place cells during virtual navigation, global remapping during environment changes, and unique responses of place cell ensembles to overhead looming stimulation.
more »
« less
- Award ID(s):
- 1835389
- PAR ID:
- 10481387
- Publisher / Repository:
- Cell Press
- Date Published:
- Journal Name:
- Neuron
- Volume:
- 111
- Issue:
- 24
- ISSN:
- 0896-6273
- Page Range / eLocation ID:
- 3941 to 3952.e6
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Virtual Reality (VR) headsets with embedded eye trackers are appearing as consumer devices (e.g. HTC Vive Eye, FOVE). These devices could be used in VR-based education (e.g., a virtual lab, a virtual field trip) in which a live teacher guides a group of students. The eye tracking could enable better insights into students’ activities and behavior patterns. For real-time insight, a teacher’s VR environment can display student eye gaze. These visualizations would help identify students who are confused/distracted, and the teacher could better guide them to focus on important objects. We present six gaze visualization techniques for a VR-embedded teacher’s view, and we present a user study to compare these techniques. The results suggest that a short particle trail representing eye trajectory is promising. In contrast, 3D heatmaps (an adaptation of traditional 2D heatmaps) for visualizing gaze over a short time span are problematic.more » « less
-
Blascheck, Tanja; Bradshaw, Jessica; Vrzakova, Hana (Ed.)Virtual Reality (VR) technology has advanced to include eye-tracking, allowing novel research, such as investigating how our visual system coordinates eye movements with changes in perceptual depth. The purpose of this study was to examine whether eye tracking could track perceptual depth changes during a visual discrimination task. We derived two depth-dependent variables from eye tracker data: eye vergence angle (EVA) and interpupillary distance (IPD). As hypothesized, our results revealed that shifting gaze from near-to-far depth significantly decreased EVA and increased IPD, while the opposite pattern was observed while shifting from far-to-near. Importantly, the amount of change in these variables tracked closely with relative changes in perceptual depth, and supported the hypothesis that eye tracker data may be used to infer real-time changes in perceptual depth in VR. Our method could be used as a new tool to adaptively render information based on depth and improve the VR user experience.more » « less
-
Abstract High-resolution awake mouse fMRI remains challenging despite extensive efforts to address motion-induced artifacts and stress. This study introduces an implantable radiofrequency (RF) surface coil design that minimizes image distortion caused by the air/tissue interface of mouse brains while simultaneously serving as a headpost for fixation during scanning. Using a 14T scanner, high-resolution fMRI enabled brain-wide functional mapping of visual and vibrissa stimulation at 100x100x200µm resolution with a 2s per frame sampling rate. Besides activated ascending visual and vibrissa pathways, robust BOLD responses were detected in the anterior cingulate cortex upon visual stimulation and spread through the ventral retrosplenial area (VRA) with vibrissa air-puff stimulation, demonstrating higher-order sensory processing in association cortices of awake mice. In particular, the rapid hemodynamic responses in VRA upon vibrissa stimulation showed a strong correlation with the hippocampus, thalamus, and prefrontal cortical areas. Cross-correlation analysis with designated VRA responses revealed early positive BOLD signals at the contralateral barrel cortex (BC) occurring 2 seconds prior to the air-puff in awake mice with repetitive stimulation, which was not detectable with the randomized stimulation paradigm. This early BC activation indicated learned anticipation through the vibrissa system and association cortices in awake mice under continuous training of repetitive air-puff stimulation. This work establishes a high-resolution awake mouse fMRI platform, enabling brain-wide functional mapping of sensory signal processing in higher association cortical areas. Significance StatementThis awake mouse fMRI platform was developed by implementing an advanced implantable radiofrequency (RF) coil scheme, which simultaneously served as a headpost to secure the mouse head during scanning. The ultra-high spatial resolution (100x100x200µm) BOLD fMRI enabled the brain-wide mapping of activated visual and vibrissa systems during sensory stimulation in awake mice, including association cortices, e.g. anterior cingulate cortex and retrosplenial cortex, for high order sensory processing. Also, the activation of barrel cortex at 2 s prior to the air-puff indicated a learned anticipation of awake mice under continuous training of the repetitive vibrissa stimulation.more » « less
-
Head-mounted miniaturized two-photon microscopes are powerful tools to record neural activity with cellular resolution deep in the mouse brain during unrestrained, free-moving behavior. Two-photon microscopy, however, is traditionally limited in imaging frame rate due to the necessity of raster scanning the laser excitation spot over a large field-of-view (FOV). Here, we present two multiplexed miniature two-photon microscopes (M-MINI2Ps) to increase the imaging frame rate while preserving the spatial resolution. Two different FOVs are imaged simultaneously and then demixed temporally or computationally. We demonstrate large-scale (500×500 µm2 FOV) multiplane calcium imaging in visual cortex and prefrontal cortex in freely moving mice during spontaneous exploration, social behavior, and auditory stimulus. Furthermore, the increased speed of M-MINI2Ps also enables two-photon voltage imaging at 400 Hz over a 380×150 µm2 FOV in freely moving mice. M-MINI2Ps have compact footprints and are compatible with the open-source MINI2P. M-MINI2Ps, together with their design principles, allow the capture of faster physiological dynamics and population recordings over a greater volume than currently possible in freely moving mice, and will be a powerful tool in systems neuroscience. # Data for: Multiplexed miniaturized two-photon microscopy (M-MINI2Ps) Dataset DOI: [10.5061/dryad.kd51c5bkp](10.5061/dryad.kd51c5bkp) ## Description of the data and file structure Calcium and Voltage imaging datasets from Multiplexed Miniaturized Two-Photon Microscopy (M-MINI2P) ### Files and variables #### File: TM_MINI2P_Voltage_Cranial_VisualCortex.zip **Description:** Voltage imaging dataset acquired in mouse primary visual cortex (V1) using the TM-MINI2P system through a cranial window preparation. This .zip file contains two Tif files, corresponding to the top field of view (FOV) and the bottom field of view (FOV) of the demultiplexed recordings. #### File: TM_MINI2P_Calcium_GRIN_PFC_Auditory_Free_vs_Headfix.zip **Description:** Volumetric calcium imaging dataset from mouse prefrontal cortex (PFC) using the TM-MINI2P system with a GRIN lens implant, comparing neural responses during sound stimulation versus quiet periods, under both freely moving and head-fixed conditions. This .zip file contains 12 Tif files: top and bottom fields of view (FOVs) of the multiplexed recordings at three imaging depths (100 μm, 155 μm, and 240 μm from the end of the implanted GRIN lens), with six files from freely moving conditions and six files from head-fixed conditions. #### File: CM_MINI2P_Calcium_Cranial_VisualCortex_SocialBehavior.zip **Description:** Calcium imaging dataset from mouse primary visual cortex (V1) using the CM-MINI2P system through a cranial window, recorded during social interaction and isolated conditions. This .zip file contains 6 Tif files: multiplexed recordings from the top and bottom fields of view (FOVs), and single-FOV recordings at two imaging depths (170 µm and 250 µm). #### File: TM_MINI2P_Calcium_Cranial_VisualCortex.zip **Description:** Multi-depth calcium imaging dataset from mouse primary visual cortex (V1) using the TM-MINI2P system through a cranial window during spontaneous exploration. This .zip file contains 6 Tif files: demultiplexed recordings from two fields of view (FOV1 and FOV2) at three imaging depths (110 µm, 170 µm, and 230 µm). ## Code/software All datasets are in .tiff format and ImageJ can be used for visualization. Analysis of calcium imaging data and voltage imaging data were analyzed using CaImAn and Volpy, respectively, which are open-source packages available at [https://github.com/flatironinstitute/CaImAn](https://github.com/flatironinstitute/CaImAn).more » « less
An official website of the United States government

