skip to main content

Explore Research Products in the NSF-PAR

Title: Personalize Wayfinding Information for Fire Responders based on Virtual Reality Training Data
Modern buildings with increasing complexity can cause serious difficulties for first responders in emergency wayfinding. While real-time data collection and information analytics become easier in indoor wayfinding, a new challenge has arisen: cognitive overload due to information redundancy. Standardized and universal spatial information systems are still widely used in emergency wayfinding, ignoring first responders’ individual difference in information intake. This paper proposes and tests the theoretical framework of a spatial information systems for first responders, which reflects their individual difference in information preference and helps reduce the cognitive load in line of duty. The proposed method includes the use of Virtual Reality (VR) experiments to simulate real world buildings, and the modeling of first responders’ reactions to different information formats and contents in simulated wayfinding tasks. This work is expected to set a foundation of future spatial information system that correctly and effectively responds to first responders’ needs.  more » « less
Award ID(s):
1761459 1937878
NSF-PAR ID:
10096566
Author(s) / Creator(s):
Date Published:
Journal Name:
Proceedings of the 52nd Hawaii International Conference on System Sciences
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , Journal of computing in civil engineering)
    null (Ed.)
    Amid the rapid development of building information technologies, wayfinding information has become more accessible to building users and first responders. As a result, a realistic risk of cognitive load related to the wayfinding information processing starts to emerge. As cognition-driven adaptive wayfinding information systems become increasingly captivated to overcome challenges of cognition overload due to overwhelming information, a practical and non-invasive method to monitor and classify cognitive loads during the processing of wayfinding information is needed. This paper tests a Functional Near-Infrared Spectroscopy (fNIRS) based method to identify cognitive load related to wayfinding information processing. It provides a holistic fNIRS signal analytical pipeline to extract hemodynamic response features in the prefrontal cortex (PFC) for cognitive load classification. A human-subject experiment (N=15) based on the Sternberg working memory test was performed to model the relationship between fNIRS features and cognitive load. Personalized models were also evaluated to capture individual differences and identify unique contributing features to each person. The results find that fNIRS-based model can help classify cognitive load changes driven by the different levels of task difficulty with satisfactory performance (avg. accuracy rate 70.02±4.41 percent). The findings also demonstrate that personalized models, instead of universal models, are needed for classifying cognitive load based on neuroimaging data. fNIRS has demonstrated comparable advantages over other neuroimaging methods in cognitive load classification given its robustness to motion artifacts and the satisfactory predictability. 
    more » « less
  2. ; ; ( , 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW))
    Emergency response in indoor building evacuation is essential for effective rescue and safety management. First responders often lack the situational awareness capability to quickly assess the layout of a building upon initial entry. For occupants of the building, situational awareness becomes more important in cases of active shooter events or circumstances of fire and smoke. One of the challenges is to provide user-specific personalized evacuation routes in real-time. In multilevel building environments, the complexity of the architecture creates problems for both visual and mental representation of the 3D spaces. This paper presents three cutting edge Augmented Reality Instructional (ARI) modules that overcome the visual limitations associated with the traditional, static 2D methods of communicating evacuation plans for multilevel buildings. Using existing building features, the authors demonstrate how the three modules provide contextualized 3D visualizations that promote and support spatial knowledge acquisition and cognitive mapping thereby enhancing situational awareness. These ARI visualizations are developed for first responders and building occupants to help increase emergency preparedness and mitigate the evacuation related risks in multilevel building rescues and safety management. Specifically, the paper describes the design and implementation of the ARI modules and reports the results of the pilot studies conducted to evaluate their perceived usefulness, ease-of-use, and usability. The results suggest the desirability of further heuristic examination of three-dimensional situational awareness-based ARI application effectiveness in multilevel building evacuations. 
    more » « less
  3. ; ; ( , 2022 International Conference on Computational Science and Computational Intelligence (CSCI))
    Emergency response, navigation, and evacuation are key essentials for effective rescue and safety management. Situational awareness is a key ingredient when fire responders or emergency response personnel responds to an emergency. They have to quickly assess the layout of a building or a campus upon entry. Moreover, the occupants of a building or campus also need situational awareness for navigation and emergency response. We have developed an integrated situational awareness mobile augmented reality (AR) application for smart campus planning, management, and emergency response. Through the visualization of integrated geographic information systems and real-time data analysis, our mobile application provides insights into operational implications and offers information to support effective decision-making. Using existing building features, the authors demonstrate how the mobile AR application provides contextualized 3D visualizations that promote and support spatial knowledge acquisition and cognitive mapping thereby enhancing situational awareness. A limited user study was conducted to test the effectiveness of the proposed mobile AR application using the mobile phone usability questionnaire (MPUQ) framework. The results show that the mobile AR application was relatively easy to use and that it can be considered a useful application for navigation and evacuation. 
    more » « less
  4. ; ; ; ; ( , ASCE International Conference on Computing in Civil Engineering 2019)
    In emergency events, first responders often have to build an accurate spatial working memory of unfamiliar spaces in a short time period. This study investigates the impact of information format on first responders’ short-term spatial memory of large-scale spaces via a human-subject experiment (n=63). A virtual model was created to simulate a real building on Texas A&M University campus. A total of 28 building components were modified in the virtual model. Participants were asked to review the virtual model with one of the three methods: 2D drawing, 3D model, and VR model. After the review session, the participants were sent to the real building to identify the discrepancies, and accuracy was documented as the performance measure. The results reveal that the 3D and VR groups both significantly outperformed the 2D group in spatial working memory. This study sets the foundation to further understand how instructional information affects the performance of first responders in emergency response. 
    more » « less
  5. ; ; ; ; ( , International Conference on Autonomous Agents and Multiagent Systems (AAMAS))
    Emergency Response Management (ERM) is a critical problem faced by communities across the globe. Despite this, it is common for ERM systems to follow myopic decision policies in the real world. Principled approaches to aid ERM decision-making under uncertainty have been explored but have failed to be accepted into real systems. We identify a key issue impeding their adoption — algorithmic approaches to emergency response focus on reactive, post-incident dispatching actions, i.e. optimally dispatching a responder after incidents occur. However, the critical nature of emergency response dictates that when an incident occurs, first responders always dispatch the closest available responder to the incident. We argue that the crucial period of planning for ERM systems is not post-incident, but between incidents. This is not a trivial planning problem — a major challenge with dynamically balancing the spatial distribution of responders is the complexity of the problem. An orthogonal problem in ERM systems is planning under limited communication, which is particularly important in disaster scenarios that affect communication networks. We address both problems by proposing two partially decentralized multi-agent planning algorithms that utilize heuristics and exploit the structure of the dispatch problem. We evaluate our proposed approach using real-world data, and find that in several contexts, dynamic re-balancing the spatial distribution of emergency responders reduces both the average response time as well as its variance. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email