skip to main content


Title: Gesture commands for controlling high-level UAV behavior
Abstract

Directing groups of unmanned air vehicles (UAVs) is a task that typically requires the full attention of several operators. This can be prohibitive in situations where an operator must pay attention to their surroundings. In this paper we present a gesture device that assists operators in commanding UAVs in focus-constrained environments. The operator influences the UAVs’ behavior by using intuitive hand gesture movements. Gestures are captured using an accelerometer and gyroscope and then classified using a logistic regression model. Ten gestures were chosen to provide behaviors for a group of fixed-wing UAVs. These behaviors specified various searching, following, and tracking patterns that could be used in a dynamic environment. A novel variant of the Monte Carlo Tree Search algorithm was developed to autonomously plan the paths of the cooperating UAVs. These autonomy algorithms were executed when their corresponding gesture was recognized by the gesture device. The gesture device was trained to classify the ten gestures and accurately identified them 95% of the time. Each of the behaviors associated with the gestures was tested in hardware-in-the-loop simulations and the ability to dynamically switch between them was demonstrated. The results show that the system can be used as a natural interface to assist an operator in directing a fleet of UAVs.

Article highlights

A gesture device was created that enables operators to command a group of UAVs in focus-constrained environments.

Each gesture triggers high-level commands that direct a UAV group to execute complex behaviors.

Software simulations and hardware-in-the-loop testing shows the device is effective in directing UAV groups.

 
more » « less
NSF-PAR ID:
10225747
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
SN Applied Sciences
Volume:
3
Issue:
6
ISSN:
2523-3963
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Research Highlights

    A longitudinal experimental study documented the emergence and developmental trajectories of North American middle‐class infants' visual attention‐following skills, including gaze‐following, point‐following, and gaze‐and‐point‐following.

    A new paradigm controlled for factors including motivation, attentiveness, and visual‐search baserates. Motor development was ruled out as a predictor or limiter of the emergence of attention‐following.

    Infants did not follow attention reliably until after 6 months, and following increased slowly from 7 to 12 months.

    Infants' individual trajectories showed modest month‐to‐month stability from 8 to 12 months of age.

     
    more » « less
  2. Abstract  
    more » « less
  3. Abstract Research Highlights

    Having more maternal kin (mother and siblings) is associated with spending more time near others across developmental stages in both male and female capuchins.

    Having more offspring as a subadult or adult female is additionally associated with spending more time near others.

    A mother's average sociality (time near others) is predictive of how social her daughters (but not sons) become as juveniles and subadults (a between‐mother effect).

    Additional variation within sibling sets in this same maternal phenotype is not predictive of how social they become later relative to each other (no within‐mother effect).

     
    more » « less
  4. Abstract Research Highlights

    Four studies examined whether 4‐ to 9‐year‐old children's pain perceptions were influenced by sufferers’ wealth status.

    US children attributed more pain to White individuals of low wealth status than those of high wealth status by age seven.

    Chinese children demonstrated an earlier tendency to attribute more pain to the poor (versus the rich) compared to US children.

    Children's wealth‐based pain judgments underlied their tendency to provide healthcare resources to people of low wealth status.

     
    more » « less
  5. Unmanned aerial vehicles (UAVs) are becoming more common, presenting the need for effective human-robot communication strategies that address the unique nature of unmanned aerial flight. Visual communication via drone flight paths, also called gestures, may prove to be an ideal method. However, the effectiveness of visual communication techniques is dependent on several factors including an observer's position relative to a UAV. Previous work has studied the maximum line-of-sight at which observers can identify a small UAV [1]. However, this work did not consider how changes in distance may affect an observer's ability to perceive the shape of a UAV's motion. In this study, we conduct a series of online surveys to evaluate how changes in line-of-sight distance and gesture size affect observers' ability to identify and distinguish between UAV gestures. We first examine observers' ability to accurately identify gestures when adjusting a gesture's size relative to the size of a UAV. We then measure how observers' ability to identify gestures changes with respect to varying line-of-sight distances. Lastly, we consider how altering the size of a UAV gesture may improve an observer's ability to identify drone gestures from varying distances. Our results show that increasing the gesture size across varying UAV to gesture ratios did not have a significant effect on participant response accuracy. We found that between 17 m and 75 m from the observer, their ability to accurately identify a drone gesture was inversely proportional to the distance between the observer and the drone. Finally, we found that maintaining a gesture's apparent size improves participant response accuracy over changing line-of-sight distances. 
    more » « less