skip to main content


Title: Human-Centric Situational Awareness and Big Data Visualization
Human-centric situational awareness and visualization are needed for analyzing the big data in an efficient way. One of the challenges is to create an algorithm to analyze the given data without any help of other data analyzing tools. This research effort aims to identify how graphical objects (such as data-shapes) developed in accordance with an analyst's mental model can enhance analyst's situation awareness. Our approach for improved big data visualization is two-fold, focusing on both visualization and interaction. This paper presents the developed data and graph technique based on forcedirected model graph in 3D. It is developed using Unity 3D gaming engine. Pilot testing was done with different data sets for checking the efficiency of the system in immersive environment and non-immersive environment. The application is able to handle the data successfully for the given data sets in data visualization. The currently graph can render around 200 to 300 linked nodes in real-time.  more » « less
Award ID(s):
1923986
NSF-PAR ID:
10189035
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
EPiC series in computing
Volume:
64
ISSN:
2398-7340
Page Range / eLocation ID:
51-60
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Situational awareness provides the decision making capability to identify, process, and comprehend big data. In our approach, situational awareness is achieved by integrating and analyzing multiple aspects of data using stacked bar graphs and geographic representations of the data. We provide a data visualization tool to represent COVID pandemic data on top of the geographical information. The combination of geospatial and temporal data provides the information needed to conduct situational analysis for the COVID-19 pandemic. By providing interactivity, geographical maps can be viewed from different perspectives and offer insight into the dynamical aspects of the COVID-19 pandemic for the fifty states in the USA. We have overlaid dynamic information on top of a geographical representation in an intuitive way for decision making. We describe how modeling and simulation of data increase situational awareness, especially when coupled with immersive virtual reality interaction. This paper presents an immersive virtual reality (VR) environment and mobile environment for data visualization using Oculus Rift head-mounted display and smartphones. This work combines neural network predictions with human-centric situational awareness and data analytics to provide accurate, timely, and scientific strategies in combatting and mitigating the spread of the coronavirus pandemic. Testing and evaluation of the data visualization tool have been done with real-time feed of COVID pandemic data set for immersive environment, non-immersive environment, and mobile environment. 
    more » « less
  2. Chen, J.Y.C. ; Fragomeni, G (Ed.)
    Visualizing data effectively is critical for the discovery process in the age of big data. We are exploring the use of immersive virtual reality platforms for scientific data visualization for COVID-19 pandemic. We are interested in finding ways to better understand, perceive and interact with multidimensional data in the field of cognition technology and human-computer interaction. Immersive visualization leads to a better understanding and perception of relationships in the data. This paper presents a data visualization tool for immersive data visualizations based on the Unity development platform. The data visualization tool is capable of visualizing the real-time COVID pandemic data for the fifty states in the USA. Immersion provides a better understanding of the data than traditional desktop visualization tools and leads to more human-centric situational awareness insights. This research effort aims to identify how graphical objects like charts and bar graphs depicted in Virtual Reality tools, developed in accordance with an analyst’s mental model can enhance an analyst’s situation awareness. Our results also suggest that users feel more satisfied when using immersive virtual reality data visualization tools and thus demonstrate the potential of immersive data analytics. 
    more » « less
  3. Active shooter events are not emergencies that can be reasonably anticipated. However, these events do occur more than we think, and there is a critical need for an effective emergency preparedness plan that can increase the likelihood of saving lives and reducing casualties in the event of an active shooting incident. There has been a major concern about the lack of tools available to allow for modeling and simulation of human behavior during emergency response training. Over the past few decades, virtual reality-based training for emergency response and decision making has been recognized as a novel alternative for disaster preparedness. This paper presents an immersive virtual reality (VR) training module for active shooter events for a building emergency response. There are two immersive active shooter modules developed: occupant’s module and Security personnel module. We have developed an immersive virtual reality training module for active shooter events using an Oculus for the course of action, visualization, and situational awareness for active shooter events. The immersive environment is implemented in Unity 3D where the user has an option to enter the environment as security personnel or as an occupant in the building. The immersive VR training module offers a unique platform for emergency response and decision making training. The platform allows for collecting data on different what-if scenarios in response to active shooter events that impact the actions of security personnel and occupants in a building. The data collected can be used to educate security personnel on how to reduce response times. Moreover, security personnel can be trained to respond to a variety of emergencies safely and securely without ever being exposed to real-world dangers. 
    more » « less
  4. Badminton is a fast-paced sport that requires a strategic combination of spatial, temporal, and technical tactics. To gain a competitive edge at high-level competitions, badminton professionals frequently analyze match videos to gain insights and develop game strategies. However, the current process for analyzing matches is time-consuming and relies heavily on manual note-taking, due to the lack of automatic data collection and appropriate visualization tools. As a result, there is a gap in effectively analyzing matches and communicating insights among badminton coaches and players. This work proposes an end-to-end immersive match analysis pipeline designed in close collaboration with badminton professionals, including Olympic and national coaches and players. We present VIRD, a VR Bird (i.e., shuttle) immersive analysis tool, that supports interactive badminton game analysis in an immersive environment based on 3D reconstructed game views of the match video. We propose a top-down analytic workflow that allows users to seamlessly move from a high-level match overview to a detailed game view of individual rallies and shots, using situated 3D visualizations and video. We collect 3D spatial and dynamic shot data and player poses with computer vision models and visualize them in VR. Through immersive visualizations, coaches can interactively analyze situated spatial data (player positions, poses, and shot trajectories) with flexible viewpoints while navigating between shots and rallies effectively with embodied interaction. We evaluated the usefulness of VIRD with Olympic and national-level coaches and players in real matches. Results show that immersive analytics supports effective badminton match analysis with reduced context-switching costs and enhances spatial understanding with a high sense of presence. 
    more » « less
  5. null (Ed.)
    Real-time data visualization can enhance decision making and empower teams with human-centric situational awareness insights. Decision making relies on data which comes in overwhelming velocity and volume, that one cannot comprehend it without some layer of abstraction. This research effort aims to demonstrate the data visualization of the COVID pandemic in real-time for the fifty states in the USA. Our proposed data visualization tool includes both conceptual and data-driven information. The data visualization includes stacked bar graphs, geographic representations of the data, and offers situational awareness of the COVID-19 pandemic. This paper describes the development and testing of the data visualization tool using the Unity gaming engine. Testing has been done with a real-time feed of the COVID-19 data set for immersive environment, non-immersive environment, and mobile environment. 
    more » « less