skip to main content


Title: A new psychometric task measuring spatial perspective taking in ambulatory virtual reality
Spatial perspective taking is an essential cognitive ability that enables people to imagine how an object or scene would appear from a perspective different from their current physical viewpoint. This process is fundamental for successful navigation, especially when people utilize navigational aids (e.g., maps) and the information provided is shown from a different perspective. Research on spatial perspective taking is primarily conducted using paper-pencil tasks or computerized figural tasks. However, in daily life, navigation takes place in a three-dimensional (3D) space and involves movement of human bodies through space, and people need to map the perspective indicated by a 2D, top down, external representation to their current 3D surroundings to guide their movements to goal locations. In this study, we developed an immersive viewpoint transformation task (iVTT) using ambulatory virtual reality (VR) technology. In the iVTT, people physically walked to a goal location in a virtual environment, using a first-person perspective, after viewing a map of the same environment from a top-down perspective. Comparing this task with a computerized version of a popular paper-and-pencil perspective taking task (SOT: Spatial Orientation Task), the results indicated that the SOT is highly correlated with angle production error but not distance error in the iVTT. Overall angular error in the iVTT was higher than in the SOT. People utilized intrinsic body axes (front/back axis or left/right axis) similarly in the SOT and the iVTT, although there were some minor differences. These results suggest that the SOT and the iVTT capture common variance and cognitive processes, but are also subject to unique sources of error caused by different cognitive processes. The iVTT provides a new immersive VR paradigm to study perspective taking ability in a space encompassing human bodies, and advances our understanding of perspective taking in the real world.  more » « less
Award ID(s):
2024633
NSF-PAR ID:
10465603
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Frontiers in Virtual Reality
Volume:
3
ISSN:
2673-4192
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Virtual reality is a powerful tool for teaching 3D digital technologies in building engineering, as it facilitates the spatial perception of three-dimensional space. Spatial orientation skill is necessary for understanding 3D space. With VR, users navigate through virtually designed buildings and must be constantly aware of their position relative to other elements of the environment (orientation during navigation). In the present study, 25 building engineering students performed navigation tasks in a desktop-VR environment workshop. Performance of students using the desktop-VR was compared to a previous workshop in which navigation tasks were carried out using head-mounted displays. The Perspective Taking/Spatial Orientation Test measured spatial orientation skill. A questionnaire on user experience in the virtual environment was also administered. The gain in spatial orientation skill was 12.62%, similar to that obtained with head-mounted displays (14.23%). The desktop VR environment is an alternative to the HMD-VR environment for planning strategies to improve spatial orientation. Results from the user-experience questionnaire showed that the desktop VR environment strategy was well perceived by students in terms of interaction, 3D visualization, navigation, and sense of presence. Unlike in the HDM VR environment, student in the desktop VR environment did not report feelings of fatigue or dizziness. 
    more » « less
  2. Research on spatial thinking requires reliable and valid measures of individual differences in various component skills. Spatial perspective taking (PT)-the ability to represent viewpoints different from one's own-is one kind of spatial skill that is especially relevant to navigation. This study had two goals. First, the psychometric properties of four PT tests were examined: Four Mountains Task (FMT), Spatial Orientation Task (SOT), Perspective-Taking Task for Adults (PTT-A), and Photographic Perspective-Taking Task (PPTT). Using item response theory (IRT), item difficulty, discriminability, and efficiency of item information functions were evaluated. Second, the relation of PT scores to general intelligence, working memory, and mental rotation (MR) was assessed. All tasks showed good construct validity except for FMT. PPTT tapped a wide range of PT ability, with maximum measurement precision at average ability. PTT-A captured a lower range of ability. Although SOT contributed less measurement information than other tasks, it did well across a wide range of PT ability. After controlling for general intelligence and working memory, original and IRT-refined versions of PT tasks were each related to MR. PTT-A and PPTT showed relatively more divergent validity from MR than SOT. Tests of dimensionality indicated that PT tasks share one common PT dimension, with secondary task-specific factors also impacting the measurement of individual differences in performance. Advantages and disadvantages of a hybrid PT test that includes a combination of items across tasks are discussed. 
    more » « less
  3. Owing to the increasing dynamics and complexity of construction tasks, workers often need to memorize a big amount of engineering information prior to the operations, such as spatial orientations and operational procedures. The working memory development, as a result, is critical to the performance and safety of many construction tasks. This study investigates how the format of engineering information affects human working memory based on a human-subject Virtual Reality (VR) experiment (n=90). A VR model was created to simulate a pipe maintenance task. First, participants were asked to review the task procedures in one of the following formats, including 2D isometric drawings, 3D model, and VR model. After the review session, participants were asked to perform the pipe maintenance task in the virtual environment based on their working memory. The operation accuracy and time were used as the key performance indicators of the working memory development. The experiment results indicate that the 3D and VR groups outperformed the 2D group in both operation accuracy and time, suggesting that a more immersive instruction leads to a better working memory. A further examination finds that the 2D group presented a significantly higher level of intrinsic cognitive load and extraneous cognitive load in the working memory development compared to the 3D and VR groups, indicating that different engineering information formats can cause different levels of cognitive load in working memory development, and ultimately affect the final performance. The findings are expected to inspire the design of intelligent information systems that adapt to the cognitive load of construction workers for improved working memory development. 
    more » « less
  4. null (Ed.)
    Objective Evaluate and model the advantage of a situation awareness (SA) supported by an augmented reality (AR) display for the ground-based joint terminal attack Controller (JTAC), in judging and describing the spatial relations between objects in a hostile zone. Background The accurate world-referenced description of relative locations of surface objects, when viewed from an oblique slant angle (aircraft, observation post) is hindered by (1) the compression of the visual scene, amplified at a lower slang angle, (2) the need for mental rotation, when viewed from a non-northerly orientation. Approach Participants viewed a virtual reality (VR)-simulated four-object scene from either of two slant angles, at each of four compass orientations, either unaided, or aided by an AR head-mounted display (AR-HMD), depicting the scene from a top-down (avoiding compression) and north-up (avoiding mental rotation) perspective. They described the geographical layout of four objects within the display. Results Compared with the control condition, that condition supported by the north-up SA display shortened the description time, particularly on non-northerly orientations (9 s, 30% benefit), and improved the accuracy of description, particularly for the more compressed scene (lower slant angle), as fit by a simple computational model. Conclusion The SA display provides large, significant benefits to this critical phase of ground-air communications in managing an attack—as predicted by the task analysis of the JTAC. Application Results impact the design of the AR-HMD to support combat ground-air communications and illustrate the magnitude by which basic cognitive principles “scale up” to realistically simulated real-world tasks such as search and rescue. 
    more » « less
  5. null (Ed.)
    Third-person is a popular perspective for video games, but virtual reality (VR) seems to be primarily experienced from a first-person point of view (POV). While a first-person POV generally offers the highest presence; a third-person POV allows users to see their avatar; which allows for a better bond, and the higher vantage point generally increases spatial awareness and navigation. Third-person locomotion is generally implemented using a controller or keyboard, with users often sitting down; an approach that is considered to offer a low presence and embodiment. We present a novel thirdperson locomotion method that enables a high avatar embodiment by integrating skeletal tracking with head-tilt based input to enable omnidirectional navigation beyond the confines of available tracking space. By interpreting movement relative to an avatar, the user will always keep facing the camera which optimizes skeletal tracking and keeps required instrumentation minimal (1 depth camera). A user study compares the performance, usability, VR sickness incidence and avatar embodiment of our method to using a controller for a navigation task that involves interacting with objects. Though a controller offers a higher performance and usability, our locomotion method offered a significantly higher avatar embodiment. 
    more » « less