Abstract External representations powerfully support and augment complex human behavior. When navigating, people often consult external representations to help them find the way to go, but do maps or verbal instructions improve spatial knowledge or support effective wayfinding? Here, we examine spatial knowledge with and without external representations in two studies where participants learn a complex virtual environment. In the first study, we asked participants to generate their own maps or verbal instructions, partway through learning. We found no evidence of improved spatial knowledge in a pointing task requiring participants to infer the direction between two targets, either on the same route or on different routes, and no differences between groups in accurately recreating a map of the target landmarks. However, as a methodological note, pointing was correlated with the accuracy of the maps that participants drew. In the second study, participants had access to an accurate map or set of verbal instructions that they could study while learning the layout of target landmarks. Again, we found no evidence of differentially improved spatial knowledge in the pointing task, although we did find that the map group could recreate a map of the target landmarks more accurately. However, overall improvement was high. There was evidence that the nature of improvement across all conditions was specific to initial navigation ability levels. Our findings add to a mixed literature on the role of external representations for navigation and suggest that more substantial intervention—more scaffolding, explicit training, enhanced visualization, perhaps with personalized sequencing—may be necessary to improve navigation ability.
more »
« less
Measuring configural spatial knowledge: Individual differences in correlations between pointing and shortcutting
Abstract People use environmental knowledge to maintain a sense of direction in daily life. This knowledge is typically measured by having people point to unseen locations (judgments of relative direction) or navigate efficiently in the environment (shortcutting). Some people can estimate directions precisely, while others point randomly. Similarly, some people take shortcuts not experienced during learning, while others mainly follow learned paths. Notably, few studies have directly tested the correlation between pointing and shortcutting performance. We compared pointing and shortcutting in two experiments, one using desktop virtual reality (VR) (N = 57) and one using immersive VR (N = 48). Participants learned a new environment by following a fixed route and were then asked to point to unseen locations and navigate to targets by the shortest path. Participants’ performance was clustered into two groups using K-means clustering. One (lower ability) group pointed randomly and showed low internal consistency across trials in pointing, but were able to find efficient routes, and their pointing and efficiency scores were not correlated. The others (higher ability) pointed precisely, navigated by efficient routes, and their pointing and efficiency scores were correlated. These results suggest that with the same egocentric learning experience, the correlation between pointing and shortcutting depends on participants’ learning ability, and internal consistency and discriminating power of the measures. Inconsistency and limited discriminating power can lead to low correlations and mask factors driving human variation. Psychometric properties, largely under-reported in spatial cognition, can advance our understanding of individual differences and cognitive processes for complex spatial tasks.
more »
« less
- Award ID(s):
- 2024633
- PAR ID:
- 10466004
- Date Published:
- Journal Name:
- Psychonomic Bulletin & Review
- ISSN:
- 1069-9384
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
As electric-vehicle (EV) sales keep rising, EV-related incidents are becoming more frequent, yet many first responders still rely on traditional training and feel unprepared for the new challenges. To help address this gap, we created a virtual reality (VR) training system that offers an interactive and immersive learning environment without real-world risks. We compared the VR system with two other learning formats—text-based and video-based—in a controlled study that enrolled university students and firefighters. Participants were randomly assigned to one format, completed a self-evaluation before and after training, then took a multiple-choice test immediately afterward. The identical test was sent to them again two weeks later to measure long-term retention. Usability, perceived usefulness, and workload were also recorded. All three methods improved participants’ knowledge. VR and text showed better results than video in immediate learning. However, VR stood out for long-term retention, showing the smallest drop in scores after 2 weeks. Participants also found VR experience more engaging and realistic. These findings suggest that VR can be a powerful tool to better prepare first responders for EV emergencies.more » « less
-
Social VR has increased in popularity due to its affordances for rich, embodied, and nonverbal communication. However, nonverbal communication remains inaccessible for blind and low vision people in social VR. We designed accessible cues with audio and haptics to represent three nonverbal behaviors: eye contact, head shaking, and head nodding. We evaluated these cues in real-time conversation tasks where 16 blind and low vision participants conversed with two other users in VR. We found that the cues were effective in supporting conversations in VR. Participants had statistically significantly higher scores for accuracy and confidence in detecting attention during conversations with the cues than without. We also found that participants had a range of preferences and uses for the cues, such as learning social norms. We present design implications for handling additional cues in the future, such as the challenges of incorporating AI. Through this work, we take a step towards making interpersonal embodied interactions in VR fully accessible for blind and low vision people.more » « less
-
The goal of this research is to provide much needed empirical data on how the fidelity of popular hand gesture tracked based pointing metaphors versus commodity controller based input affects the efficiency and speed-accuracy tradeoff in users’ spatial selection in personal space interactions in VR. We conduct two experiments in which participants select spherical targets arranged in a circle in personal space, or near-field within their maximum arms reach distance, in VR. Both experiments required participants to select the targets with either a VR controller or with their dominant hand’s index finger, which was tracked with one of two popular contemporary tracking methods. In the first experiment, the targets are arranged in a flat circle in accordance with the ISO 9241-9 Fitts’ law standard, and the simulation selected random combinations of 3 target amplitudes and 3 target widths. Targets were placed centered around the users’ eye level, and the arrangement was placed at either 60%, 75%, or 90% depth plane of the users’ maximum arm’s reach. In experiment 2, the targets varied in depth randomly from one depth plane to another within the same configuration of 13 targets within a trial set, which resembled button selection task in hierarchical menus in differing depth planes in the near-field. The study was conducted using the HTC Vive head-mounted display, and used either a VR controller (HTC Vive), low-fidelity virtual pointing (Leap Motion), or a high-fidelity virtual pointing (tracked VR glove) conditions. Our results revealed that low-fidelity pointing performed worse than both high-fidelity pointing and the VR controller. Overall, target selection performance was found to be worse in depth planes closer to the maximum arms reach, as compared to middle and nearer distances.more » « less
-
Gonzalez, V; Zhang, J; de_Soto, B; Brilakis, I (Ed.)The construction industry is witnessing an increasing adoption of virtual reality (VR) technology for training and education purposes. Given this trend, it becomes essential to critically investigate the impact it has on learners, especially when compared to traditional paper-based learning method. In this paper, the authors developed a close-to-reality virtual system using the Unity3D game engine. Participants engage in learning safety protocols, operating a virtual crane, and assembling a steel structure within this environment. Corresponding paper-based instructional materials were also developed for comparison. The study involved 16 participants who were randomly assigned to either the VR training or the traditional paper-based training, their brainwaves data were recorded through electroencephalography (EEG) headset during the training progress to assess their emotions. Results show that an individual is most likely to experience exciting emotions when they are training in the VR system compared with the traditional training method. The correlation with actual safety performance, however, remains unclear and requires further investigation.more » « less
An official website of the United States government

