skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Developing Future Wearable Interfaces for Human-Drone Teams through a Virtual Drone Search Game
Autonomous robotic vehicles (i.e., drones) are potentially transformative for search and rescue (SAR). This paper works toward wearable interfaces, through which humans team with multiple drones. We introduce the Virtual Drone Search Game as a first step in creating a mixed reality simulation for humans to practice drone teaming and SAR techniques. Our goals are to (1) evaluate input modalities for the drones, derived from an iterative narrowing of the design space, (2) improve our mixed reality system for designing input modalities and training operators, and (3) collect data on how participants socially experience the virtual drones with which they work. In our study, 17 participants played the game with two input modalities (Gesture condition, Tap condition) in counterbalanced order. Results indicated that participants performed best with the Gesture condition. Participants found the multiple controls challenging, and future studies might include more training of the devices and game. Participants felt like a team with the drones and found them moderately agentic. In our future work, we will extend this testing to a more externally valid mixed reality game.  more » « less
Award ID(s):
1914635 1849591 1651532 1619273
PAR ID:
10208810
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
International Journal of Human-Computer Studies
Date Published:
Journal Name:
International Journal of Human-Computer Studies
Volume:
147
Issue:
C
ISSN:
1071-5819
Page Range / eLocation ID:
102573
Subject(s) / Keyword(s):
human-drone teams drones wearables mixed reality HMD gesture interface empirical study
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; (, ISCRAM 2018 Conference Proceedings – 15th International Conference on Information Systems for Crisis Response and Management)
    Boersma, Kees; Tomaszeski, Brian (Ed.)
    The proliferation of unmanned aerial systems (i.e., drones) can provide great value to the future of search and rescue. However, with the increase adoption of such systems, issues around hybrid human-drone team coordination and planning will arise. To address these early challenges, we provide insights into the development of testbeds in the form of mixed reality games with simulated drones. This research presents an architecture to address challenges and opportunities in using drones for search and rescue. On this architecture, we develop a mixed reality game in which human players engage with the physical world and with gameplay that is purely virtual. We expect the architecture to be useful to a range of researchers an practitioners, forming the basis for investigating and training within this unique, new domain. 
    more » « less
  2. ; ; ; (, EPiC Series in Built Environment)
    Integrating drones into construction sites can introduce new risks to workers who already work in hazardous environments. Consequently, several recent studies have investigated the safety challenges and solutions associated with this technology integration in construction. However, there is a knowledge gap about effectively communicating such safety challenges to construction professionals and students who may work alongside drones on job sites. In this study, a 360-degree virtual reality (VR) environment was created as a training platform to communicate the safety challenges of worker-drone interactions on construction jobsites. This pilot study assesses the learning effectiveness and user experience of the developed 360 VR worker-drone safety training, which provides an immersive device-agnostic learning experience. The result indicates that such 360 VR learning material could significantly increase the safety knowledge of users while delivering an acceptable user experience in most of its assessment criteria. The outcomes of this study will serve as a valuable resource for improving future worker-drone safety training materials. 
    more » « less
  3. ; ; (, International Conference on Automation Science and Engineering (IEEE CASE 22-26 August 2019, Vancouver, Canada))
    It is now possible to deploy swarms of drones with populations in the thousands. There is growing interest in using such swarms for defense, and it has been natural to program them with bio-mimetic motion models such as flocking or swarming. However, these motion models evolved to survive against predators, not enemies with modern firearms. This paper presents experimental data that compares the survivability of several motion models for large numbers of drones. This project tests drone swarms in Virtual Reality (VR), because it is prohibitively expensive, technically complex, and potentially dangerous to fly a large swarm of drones in a testing environment. We model the behavior of drone swarms flying along parametric paths in both tight and scattered formations. We add random motion to the general motion plan to confound path prediction and targeting. We describe an implementation of these flight paths as game levels in a VR environment. We then allow players to shoot at the drones and evaluate the difference between flocking and swarming behavior on drone survivability. 
    more » « less
  4. ; ; (, CIB Conferences)
    While drones have exhibited considerable potential to revolutionize the construction industry, previous studies across domains have proposed that human-drone interaction could cause adverse impacts on humans (e.g., collision and discomfort). Given that construction has been recognized as a hazardous and high-stress workplace, it deserves deep exploration regarding how newly introduced drones will influence worker well-being during the interaction. However, there is a paucity of research on worker stress when communicating with drones in construction. Successful human-drone interaction must necessitate seamless and comfortable communication between workers and drones. Therefore, this study investigates the impact of physically demanding response levels on construction workers’ mental and physical well-being throughout the communication cycle. Three levels of physical responses (low, medium, and high) required for drone communication were simulated in an extended reality roofing experiment. During the communication process, real-time stress levels were assessed through participants’ electrodermal activity. The results indicated that a higher physical level of communication significantly increased workers’ higher stress levels in both the response and decoding phases. Additionally, providing drones’ feedback in verbal human-drone communication is especially important to reduce workers’ confusion and mental stress. This study highlights the critical need for worker-centric design and communication strategies in drone integration within construction. 
    more » « less
  5. ; ; (, Proceedings of the Halfway to the Future Symposium 2019)
    Search and rescue (SAR) operations are often nearly computer-technology-free due to the fragility and connectivity needs of current information communication technology (ICT). In this design fiction, we envision a world where SAR uses augmented reality (AR) and the surplus labor of volunteers during crisis response efforts. Unmanned aerial vehicles, crowdsourced mapping platforms, and concepts from video game mapping technologies can all be mixed to keep SAR operations complexity-free while incorporating ICTs. Our scenario describes a near-future SAR operation with currently available technology being assembled and deployed without issue. After our scenario, we discuss socio-technical barriers for technology use like technical fragility and overwhelming complexity. We also discuss how to work around those barriers and how to use video games as a testbed for SAR technology. We hope to inspire more resilient ICT design that is accessible without training. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email