skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Studying collective animal behaviour with drones and computer vision
Abstract Drones are increasingly popular for collecting behaviour data of group‐living animals, offering inexpensive and minimally disruptive observation methods. Imagery collected by drones can be rapidly analysed using computer vision techniques to extract information, including behaviour classification, habitat analysis and identification of individual animals. While computer vision techniques can rapidly analyse drone‐collected data, the success of these analyses often depends on careful mission planning that considers downstream computational requirements—a critical factor frequently overlooked in current studies.We present a comprehensive summary of research in the growing AI‐driven animal ecology (ADAE) field, which integrates data collection with automated computational analysis focused on aerial imagery for collective animal behaviour studies. We systematically analyse current methodologies, technical challenges and emerging solutions in this field, from drone mission planning to behavioural inference. We illustrate computer vision pipelines that infer behaviour from drone imagery and present the computer vision tasks used for each step. We map specific computational tasks to their ecological applications, providing a framework for future research design.Our analysis reveals AI‐driven animal ecology studies for collective animal behaviour using drone imagery focus on detection and classification computer vision tasks. While convolutional neural networks (CNNs) remain dominant for detection and classification tasks, newer architectures like transformer‐based models and specialized video analysis networks (e.g. X3D, I3D, SlowFast) designed for temporal pattern recognition are gaining traction for pose estimation and behaviour inference. However, reported model accuracy varies widely by computer vision task, species, habitats and evaluation metrics, complicating meaningful comparisons between studies.Based on current trends, we conclude semi‐autonomous drone missions will be increasingly used to study collective animal behaviour. While manual drone operation remains prevalent, autonomous drone manoeuvrers, powered by edge AI, can scale and standardise collective animal behavioural studies while reducing the risk of disturbance and improving data quality. We propose guidelines for AI‐driven animal ecology drone studies adaptable to various computer vision tasks, species and habitats. This approach aims to collect high‐quality behaviour data while minimising disruption to the ecosystem.  more » « less
Award ID(s):
2112606
PAR ID:
10640811
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  ;  ;  ;  
Publisher / Repository:
Methods in Ecology and Evolution Journal
Date Published:
Journal Name:
Methods in Ecology and Evolution
Volume:
16
Issue:
10
ISSN:
2041-210X
Page Range / eLocation ID:
2229 to 2259
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Drones have become invaluable tools for studying animal behaviour in the wild, enabling researchers to collect aerial video data of group‐living animals. However, manually piloting drones to track animal groups consistently is challenging due to complex factors such as terrain, vegetation, group spread and movement patterns. The variability in manual piloting can result in unusable data for downstream behavioural analysis, making it difficult to collect standardized datasets for studying collective animal behaviour.To address these challenges, we present WildWing, a complete hardware and software open‐source unmanned aerial system (UAS) for autonomously collecting behavioural video data of group‐living animals. The system's main goal is to automate and standardize the collection of high‐quality aerial footage suitable for computer vision‐based behaviour analysis. We provide a novel navigation policy to autonomously track animal groups while maintaining optimal camera angles and distances for behavioural analysis, reducing the inconsistencies inherent in manual piloting.The complete WildWing system costs only $650 and incorporates drone hardware with custom software that integrates ecological knowledge into autonomous navigation decisions. The system produces 4 K resolution video at 30 fps while automatically maintaining appropriate distances and angles for behaviour analysis. We validate the system through field deployments tracking groups of Grevy's zebras, giraffes and Przewalski's horses at The Wilds conservation centre, demonstrating its ability to collect usable behavioural data consistently.By automating the data collection process, WildWing helps ensure consistent, high‐quality video data suitable for computer vision analysis of animal behaviour. This standardization is crucial for developing robust automated behaviour recognition systems to help researchers study and monitor wildlife populations at scale. The open‐source nature of WildWing makes autonomous behavioural data collection more accessible to researchers, enabling wider application of drone‐based behavioural monitoring in conservation and ecological research. 
    more » « less
  2. Abstract Drones have emerged as a cost‐effective solution to detect and map plant invasions, offering researchers and land managers flexibility in flight design, sensors and data collection schedules. A systematic review of trends in drone‐based image collection, data processing and analytical approaches is needed to advance the science of invasive species monitoring and management and improve scalability and replicability.We systematically reviewed studies using drones for plant invasion research to identify knowledge gaps, best practices and a path toward advancing the science of invasive plant monitoring and management. We devised a database of 33 standardized reporting parameters, coded each study to those parameters, calculated descriptive statistics and synthesized how these technologies are being implemented and used.Trends show a general increase in studies since 2009 with a bias toward temperate regions in North America and Europe. Most studies have focused on testing the validity of a machine learning or deep learning image classification technique with fewer studies focused on monitoring or modelling spread. Very few studies used drones for assessing ecosystem dynamics and impacts such as determining environmental drivers or tracking re‐emergence after disturbance. Overall, we noted a lack of standardized reporting on field survey design, flight design, drone systems, image processing and analyses, which hinders replicability and scalability of approaches. Based on these findings, we develop a standard framework for drone applications in invasive species monitoring to foster cross‐study comparability and reproducibility.We suggest several areas for advancing the use of drones in invasive plant studies including (1) utilizing standardized reporting frameworks to facilitate scientific research practices, (2) integrating drone data with satellite imagery to scale up relationships over larger areas, (3) using drones as an alternative to in‐person ground surveys and (4) leveraging drones to assess community trait shifts tied to plant fitness and reproduction. 
    more » « less
  3. Abstract Behavioural plasticity is a major driver in the early stages of adaptation, but its effects in mediating evolution remain elusive because behavioural plasticity itself can evolve.In this study, we investigated how male Trinidadian guppies (Poecilia reticulata) adapted to different predation regimes diverged in behavioural plasticity of their mating tactic. We reared F2 juveniles of high‐ or low‐predation population origins with different combinations of social and predator cues and assayed their mating behaviour upon sexual maturity.High‐predation males learned their mating tactic from conspecific adults as juveniles, while low‐predation males did not. High‐predation males increased courtship when exposed to chemical predator cues during development; low‐predation males decreased courtship in response to immediate chemical predator cues, but only when they were not exposed to such cues during development.Behavioural changes induced by predator cues were associated with developmental plasticity in brain morphology, but changes acquired through social learning were not.We thus show that guppy populations diverged in their response to social and ecological cues during development, and correlational evidence suggests that different cues can shape the same behaviour via different neural mechanisms. Our study demonstrates that behavioural plasticity, both environmentally induced and socially learnt, evolves rapidly and shapes adaptation when organisms colonize ecologically divergent habitats. 
    more » « less
  4. Abstract Collective motion, that is the coordinated spatial and temporal organisation of individuals, is a core element in the study of collective animal behaviour. The self‐organised properties of how a group moves influence its various behavioural and ecological processes, such as predator–prey dynamics, social foraging and migration. However, little is known about the inter‐ and intra‐specific variation in collective motion. Despite the significant advancement in high‐resolution tracking of multiple individuals within groups, providing collective motion data for animals in the laboratory and the field, a framework to perform quantitative comparisons across species and contexts is lacking.Here, we present theswaRmversepackage. Building on two existing R packages,trackdfandswaRm,swaRmverseenables the identification and analysis of collective motion ‘events’, as presented in Papadopoulou et al. (2023), creating a unit of comparison across datasets. We describe the package's structure and showcase its functionality using existing datasets from several species and simulated trajectories from an agent‐based model.From positional time‐series data for multiple individuals (x‐y‐t‐id),swaRmverseidentifies events of collective motion based on the distribution of polarisation and group speed. For each event, a suite of validated biologically meaningful metrics are calculated, and events are placed into a ‘swarm space’ through dimensional reduction techniques.Our package provides the first automated pipeline enabling the analysis of data on collective behaviour. The package allows the calculation and use of complex metrics for users without a strong quantitative background and will promote communication and data‐sharing across disciplines, standardising the quantification of collective motion across species and promoting comparative investigations. 
    more » « less
  5. Abstract Droughts are increasing in frequency and severity globally due to climate change, leading to changes in resource availability that may have cascading effects on animal ecology. Resource availability is a key driver of animal space use, which in turn influences interspecific interactions like intraguild competition. Understanding how climate‐induced changes in resource availability influence animal space use, and how species‐specific responses scale up to affect intraguild dynamics, is necessary for predicting broader community‐level responses to climatic changes.Although several studies have demonstrated the ecological impacts of drought, the behavioural responses of individuals that scale up to these broader‐scale effects are not well known, particularly among animals in top trophic levels like large carnivores. Furthermore, we currently lack understanding of how the impacts of climate variability on individual carnivore behaviour are linked to intraguild dynamics, in part because multi‐species datasets collected at timescales relevant to climatic changes are rare.Using 11 years of GPS data from four sympatric large carnivore species in southern Africa—lions (Panthera leo), leopards (Panthera pardus), African wild dogs (Lycaon pictus) and cheetahs (Acinonyx jubatus)—spanning 4 severe drought events, we test whether drought conditions impact (1) large carnivore space use, (2) broad‐scale intraguild spatial overlap and (3) fine‐scale intraguild interactions.Drought conditions expanded space use across species, with carnivores increasing their monthly home range sizes by 35% (wild dogs) to 66% (leopards). Drought conditions increased the amount of spatial overlap between lions and subordinate felids (cheetahs and leopards) by up to 119%, but only lion‐cheetah encounter rates were affected by these changes, declining in response to drought.Our findings reveal that drought has a clear signature on the space use of multiple sympatric large carnivore species, which can alter spatiotemporal partitioning between competing species. Our study thereby illuminates the links between environmental change, animal behaviour and intraguild dynamics. While fine‐scale avoidance strategies may facilitate intraguild coexistence during periodic droughts, large carnivore conservation may require considerable expansion of protected areas or revised human‐carnivore coexistence strategies to accommodate the likely long‐term increased space demands of large carnivores under projected increases in drought intensity. 
    more » « less