Emergency response in indoor building evacuation is essential for effective rescue and safety management. First responders often lack the situational awareness capability to quickly assess the layout of a building upon initial entry. For occupants of the building, situational awareness becomes more important in cases of active shooter events or circumstances of fire and smoke. One of the challenges is to provide user-specific personalized evacuation routes in real-time. In multilevel building environments, the complexity of the architecture creates problems for both visual and mental representation of the 3D spaces. This paper presents three cutting edge Augmented Reality Instructional (ARI) modules that overcome the visual limitations associated with the traditional, static 2D methods of communicating evacuation plans for multilevel buildings. Using existing building features, the authors demonstrate how the three modules provide contextualized 3D visualizations that promote and support spatial knowledge acquisition and cognitive mapping thereby enhancing situational awareness. These ARI visualizations are developed for first responders and building occupants to help increase emergency preparedness and mitigate the evacuation related risks in multilevel building rescues and safety management. Specifically, the paper describes the design and implementation of the ARI modules and reports the results of the pilot studies conducted to evaluate their perceived usefulness, ease-of-use, and usability. The results suggest the desirability of further heuristic examination of three-dimensional situational awareness-based ARI application effectiveness in multilevel building evacuations.
more »
« less
Human-Robot Interaction with Drones and Drone Swarms in Law Enforcement Clearing Operations
Police officers often must work alone in clearing operations, a procedure that involves surveying a building for threats and appropriately responding. A partnership between drone swarms and officers has potential to increase the safety of officers and civilians during these high-stress operations and reduce the risk of harm from hostile persons. This two part study examines aspects of trust, situational awareness, mental demand, performance, and human-robot interaction during law enforcement building clearing operations using either a single drone or a drone swarm. Results indicate that single drone use can increase time for operation, but accuracy and safety of clearing is enhanced. Single drone use saw increased situational awareness, a decrease in number of targets missed, and a moderate level of trust. For drone swarms, results indicate significant differences in mental workload from swarm data feeds compared to single drone feeds but no substantial difference in accuracy of finding targets.
more »
« less
- Award ID(s):
- 1757900
- PAR ID:
- 10146782
- Date Published:
- Journal Name:
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Volume:
- 63
- Issue:
- 1
- ISSN:
- 2169-5067
- Page Range / eLocation ID:
- 1213 to 1217
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Driver reliance on automated vehicles (AV) is a critical component of safety particularly during high-risk traffic scenarios. Factors that influence reliance, including trust, situation awareness, fatigue, and demographics, have been independently explored; however, few analyses have investigated predicting AV reliance and compared factors comprehensively. The goals of this study were to develop a random forest (RF) model to predict reliance and to analyze the importance of factors for reliance decisions. We leveraged data from a driving simulation study where participants encountered four traffic events including responding to an illegal vehicle crossing, managing construction zones, stopping at a vandalized stop sign, and a pedestrian detection task. The dataset included reliance decisions and subjective assessments of dispositional trust, situational trust, fatigue, and workload. An RF model fit to the dataset using cross validation achieved an average AUC of 0.81 and accuracy of 0.77 and situational trust emerged as the most influential predictor.more » « less
-
Integrating Communication and Sensor Arrays to Model and Navigate Autonomous Unmanned Aerial SystemsThe emerging concept of drone swarms creates new opportunities with major societal implications. However, future drone swarm applications and services pose new communications and sensing challenges, particularly for collaborative tasks. To address these challenges, in this paper, we integrate sensor arrays and communication to propose a mathematical model to route a collection of autonomous unmanned aerial systems (AUAS), a so-called drone swarm or AUAS swarm, without having a base station of communication but communicating with each other using multiple spatio-temporal data. The theories of structured matrices, concepts in multi-beam beamforming, and sensor arrays are utilized to propose a swarm routing algorithm. We address the routing algorithm’s computational and arithmetic complexities, precision, and reliability. We measure bit-error-rate (BER) based on the number of elements in sensor arrays and beamformed output of the members of the swarm to authenticate and secure the routing for the decentralized AUAS networking. The proposed model has the potential to enable future drone swarm applications and services. Finally, we discuss future work on obtaining a machine-learning-based low-cost drone swarm routing algorithm.more » « less
-
Situational awareness is the perception and understanding of the surrounding environment. Maintaining situational awareness is vital for performance and error prevention in safety critical domains. Prior work has examined applying augmented reality (AR) to the context of improving situational awareness, but has mainly focused on the applicability of using AR rather than on information design. Hence, there is a need to investigate how to design the presentation of information, especially in AR headsets, to increase users’ situational awareness. We conducted a Systematic Literature Review to research how information is currently presented in AR, especially in systems that are being utilized for situational awareness. Comparing current presentations of information to existing design recommendations aided in identifying future areas of design. In addition, this survey further discusses opportunities and challenges in applying AR to increasing users’ situational awareness.more » « less
-
Emergency response, navigation, and evacuation are key essentials for effective rescue and safety management. Situational awareness is a key ingredient when fire responders or emergency response personnel responds to an emergency. They have to quickly assess the layout of a building or a campus upon entry. Moreover, the occupants of a building or campus also need situational awareness for navigation and emergency response. We have developed an integrated situational awareness mobile augmented reality (AR) application for smart campus planning, management, and emergency response. Through the visualization of integrated geographic information systems and real-time data analysis, our mobile application provides insights into operational implications and offers information to support effective decision-making. Using existing building features, the authors demonstrate how the mobile AR application provides contextualized 3D visualizations that promote and support spatial knowledge acquisition and cognitive mapping thereby enhancing situational awareness. A limited user study was conducted to test the effectiveness of the proposed mobile AR application using the mobile phone usability questionnaire (MPUQ) framework. The results show that the mobile AR application was relatively easy to use and that it can be considered a useful application for navigation and evacuation.more » « less
An official website of the United States government

