skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Improving Emergency Response Training and Decision Making Using a Collaborative Virtual Reality Environment for Building Evacuation
Emergency response training is needed to remember and implement emergency operation plans (EOP) and procedures over long periods until an emergency occurs. There is also a need to develop an effective mechanism of teamwork under emergency conditions such as bomb blasts and active shooter events inside a building. One way to address these needs is to create a collaborative training module to study these emergencies and perform virtual evacuation drills. This paper presents a collaborative virtual reality (VR) environment for performing emergency response training for fire and smoke as well as for active shooter training scenarios. The collaborative environment is implemented in Unity 3D and is based on run, hide, and fight mode of emergency response. Our proposed collaborative virtual environment (CVE) is set up on the cloud and the participants can enter the VR environment as a policeman or as a civilian. We have used game creation as a metaphor for developing a CVE platform for conducting training exercises for different what-if scenarios in a safe and cost-effective manner. The novelty of our work lies in modeling behaviors of two kinds of agents in the environment: user-controlled agents and computer-controlled agents. The computer controlled agents are defined with preexisting rules of behaviors whereas the user controlled agents are autonomous agents that provide controls to the user to navigate in the CVE at their own pace. Our contribution lies in our approach to combine these two approaches of behavior to perform emergency response training for building evacuation.  more » « less
Award ID(s):
1923986 2032344
PAR ID:
10292088
Author(s) / Creator(s):
Date Published:
Journal Name:
Proceedings of 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020
Volume:
12428
Page Range / eLocation ID:
213–224
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. During active shooter events or emergencies, the ability of security personnel to respond appropriately to the situation is driven by pre-existing knowledge and skills, but also depends upon their state of mind and familiarity with similar scenarios. Human behavior becomes unpredictable when it comes to making a decision in emergency situations. The cost and risk of determining these human behavior characteristics in emergency situations is very high. This paper presents an immersive collaborative virtual reality (VR) environment for performing virtual building evacuation drills and active shooter training scenarios using Oculus Rift head mounted displays. The collaborative immersive environment is implemented in Unity 3D and is based on run, hide, and fight mode for emergency response. The immersive collaborative VR environment also offers a unique method for training in emergencies for campus safety. The participant can enter the collaborative VR environment setup on the cloud and participate in the active shooter response training environment, which leads to considerable cost advantages over large-scale real-life exercises. A presence questionnaire in the user study was used to evaluate the effectiveness of our immersive training module. The results show that a majority of users agreed that their sense of presence was increased when using the immersive emergency 
    more » « less
  2. Chen, J.Y.C. (Ed.)
    In recent years there has been a sharp increase in active shooter events, but there has been no introduction of new technology or tactics capable of increasing preparedness and training for active shooter events. This has raised a major concern about the lack of tools that would allow robust predictions of realistic human movements and the lack of understanding about the interaction in designated simulation environments. It is impractical to carry out live experiments where thousands of people are evacuated from buildings designed for every possible emergency condition. There has been progress in understanding human movement, human motion synthesis, crowd dynamics, indoor environments, and their relationships with active shooter events, but challenges remain. This paper presents a virtual reality (VR) experimental setup for conducting virtual evacuation drills in response to extreme events and demonstrates the behavior of agents during an active shooter environment. The behavior of agents is implemented using behavior trees in the Unity gaming engine. The VR experimental setup can simulate human behavior during an active shooter event in a campus setting. A presence questionnaire (PQ) was used in the user study to evaluate the effectiveness and engagement of our active shooter environment. The results show that majority of users agreed that the sense of presence was increased when using the emergency response training environment for a building evacuation environment. 
    more » « less
  3. Active shooter events are not emergencies that can be reasonably anticipated. However, these events do occur more than we think, and there is a critical need for an effective emergency preparedness plan that can increase the likelihood of saving lives and reducing casualties in the event of an active shooting incident. There has been a major concern about the lack of tools available to allow for modeling and simulation of human behavior during emergency response training. Over the past few decades, virtual reality-based training for emergency response and decision making has been recognized as a novel alternative for disaster preparedness. This paper presents an immersive virtual reality (VR) training module for active shooter events for a building emergency response. There are two immersive active shooter modules developed: occupant’s module and Security personnel module. We have developed an immersive virtual reality training module for active shooter events using an Oculus for the course of action, visualization, and situational awareness for active shooter events. The immersive environment is implemented in Unity 3D where the user has an option to enter the environment as security personnel or as an occupant in the building. The immersive VR training module offers a unique platform for emergency response and decision making training. The platform allows for collecting data on different what-if scenarios in response to active shooter events that impact the actions of security personnel and occupants in a building. The data collected can be used to educate security personnel on how to reduce response times. Moreover, security personnel can be trained to respond to a variety of emergencies safely and securely without ever being exposed to real-world dangers. 
    more » « less
  4. Recent research has used virtual environments (VEs), as presented via virtual reality (VR) headsets, to study human behavior in hypothetical fire scenarios. One goal of using VEs in fire scenarios is to elicit patterns of behavior which more closely align to how individuals would react to real fire emergency situations. The present study investigated whether elicited behaviors and perceived risk varied during fire scenarios presented as VEs via two viewing conditions. These included a VR condition, where the VE was rendered as 360-degree videos presented in a VR headset, and a screen condition, where VEs were rendered as fixed-view videos via a computer monitor screen. We predicted that the selection of actions during the scenario would vary between conditions, that participants would rate fires as more dangerous if they developed more quickly and when smoke was rendered as thicker, and that participants would report greater levels of immersion in the VR condition. A total of 159 participants completed a decision-making task where they viewed videos of an incipient fire in a residential building and judged what action to take. Initial action responses to the fire scenarios varied between both viewing and smoke conditions, with those assigned to the thicker smoke and screen conditions being more likely to take protective action. Risk ratings also varied by smoke condition, with evidence of higher perceived risk for thicker smoke. Several factors of self-reported immersion (namely ‘interest’, ‘emotional attachment’, ‘focus of attention’, and ‘flow’) were associated with risk ratings, with perceived presence associated with initial actions. The present study provides evidence that enhancing immersion and perceived risk in a VE contributes to a different pattern of behaviors during simulated fire decision-making tasks. While our investigation only addressed the ideas of presence in an environment, future research should investigate the relative contribution of interactivity and consequences within the environment to further identify how behaviors during simulated fire scenarios are affected by each of these factors. 
    more » « less
  5. During emergencies communicating in multi-level built environment becomes challenging because architectural complexity can create problems with visual and mental representation of 3D space. Our Hololens application gives a visual representation of a building on campus in 3D space, allowing people to see where exits are in the building as well as creating alerts for anomalous behavior for emergency response such as active shooter, fire, and smoke. It also gives path to the various exits; shortest path to the exits as well as directions to a safe zone from their current position. The augmented reality (AR) application was developed in Unity 3D for Microsoft HoloLens and also is deployed on tablets and smartphones. It is a fast and robust marker detection technique inspired by the use of Vuforia AR library. Our aim is to enhance the evacuation process by ensuring that all building patrons know all of the building exits and how to get to them, which improves evacuation time and eradicates the injuries and fatalities occurring during indoor crises such as building fires and active shooter events. We have incorporated existing permanent features in the building as markers for the AR application to trigger the floor plan and subsequent location of the person in the building. This work also describes the system architecture as well as the design and implementation of this AR application to leverage HoloLens for building evacuation purposes. We believe that AR technologies like HoloLens could be adopted for all building evacuating strategies during emergencies as it offers a more 
    more » « less