An official website of the United States government
Wildlife population monitoring over large geographic areas is increasingly feasible due to developments in aerial survey methods coupled with the use of computer vision models for identifying and classifying individual organisms. However, aerial surveys still occur infrequently, and there are often long delays between the acquisition of airborne imagery and its conversion into population monitoring data. Near real‐time monitoring is increasingly important for active management decisions and ecological forecasting. Accomplishing this over large scales requires a combination of airborne imagery, computer vision models to process imagery into information on individual organisms, and automated workflows to ensure that imagery is quickly processed into data following acquisition. Here we present our end‐to‐end workflow for conducting near real‐time monitoring of wading birds in the Everglades, Florida, USA. Imagery is acquired as frequently as weekly using uncrewed aircraft systems (aka drones), processed into orthomosaics (using Agisoft metashape), converted into individual‐level species data using a Retinanet‐50 object detector, post‐processed, archived, and presented on a web‐based visualization platform (using Shiny). The main components of the workflow are automated using Snakemake. The underlying computer vision model provides accurate object detection, species classification, and both total and species‐level counts for five out of six target species (White Ibis, Great Egret, Great Blue Heron, Wood Stork, and Roseate Spoonbill). The model performed poorly for Snowy Egrets due to the small number of labels and difficulty distinguishing them from White Ibis (the most abundant species). By automating the post‐survey processing, data on the populations of these species is available in near real‐time (<1 week from the date of the survey) providing information at the time scales needed for ecological forecasting and active management.
more »
« less
Using time‐series remote sensing to identify and track individual bird nests at large scales
Abstract The challenges of monitoring wildlife often limit the scales and intensity of the data that can be collected. New technologies—such as remote sensing using unoccupied aircraft systems (UASs)—can collect information more quickly, over larger areas, and more frequently than is feasible using ground‐based methods. While airborne imaging is increasingly used to produce data on the location and counts of individuals, its ability to produce individual‐based demographic information is less explored. Repeat airborne imagery to generate an imagery time series provides the potential to track individuals over time to collect information beyond one‐off counts, but doing so necessitates automated approaches to handle the resulting high‐frequency large‐spatial scale imagery. We developed an automated time‐series remote sensing approach to identifying wading bird nests in the Everglades ecosystem of Florida, USA to explore the feasibility and challenges of conducting time‐series based remote sensing on mobile animals at large spatial scales. We combine a computer vision model for detecting birds in weekly UAS imagery of colonies with biology‐informed algorithmic rules to generate an automated approach that identifies likely nests. Comparing the performance of these automated approaches to human review of the same imagery shows that our primary approach identifies nests with comparable performance to human review, and that a secondary approach designed to find quick‐fail nests resulted in high false‐positive rates. We also assessed the ability of both human review and our primary algorithm to find ground‐verified nests in UAS imagery and again found comparable performance, with the exception of nests that fail quickly. Our results showed that automating nest detection, a key first step toward estimating nest success, is possible in complex environments like the Everglades and we discuss a number of challenges and possible uses for these types of approaches.
more »
« less
- Award ID(s):
- 2326954
- PAR ID:
- 10655137
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Remote Sensing in Ecology and Conservation
- ISSN:
- 2056-3485
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Unoccupied aerial systems (UAS) are an established technique for collecting data on cold region phenomenon at high spatial and temporal resolutions. While many studies have focused on remote sensing applications for monitoring long term changes in cold regions, the role of UAS for detection, monitoring, and response to rapid changes and direct exposures resulting from abrupt hazards in cold regions is in its early days. This review discusses recent applications of UAS remote sensing platforms and sensors, with a focus on observation techniques rather than post-processing approaches, for abrupt, cold region hazards including permafrost collapse and event-based thaw, flooding, snow avalanches, winter storms, erosion, and ice jams. The pilot efforts highlighted in this review demonstrate the potential capacity for UAS remote sensing to complement existing data acquisition techniques for cold region hazards. In many cases, UASs were used alongside other remote sensing techniques (e.g., satellite, airborne, terrestrial) andin situsampling to supplement existing data or to collect additional types of data not included in existing datasets (e.g., thermal, meteorological). While the majority of UAS applications involved creation of digital elevation models or digital surface models using Structure-from-Motion (SfM) photogrammetry, this review describes other applications of UAS observations that help to assess risks, identify impacts, and enhance decision making. As the frequency and intensity of abrupt cold region hazards changes, it will become increasingly important to document and understand these changes to support scientific advances and hazard management. The decreasing cost and increasing accessibility of UAS technologies will create more opportunities to leverage these techniques to address current research gaps. Overcoming challenges related to implementation of new technologies, modifying operational restrictions, bridging gaps between data types and resolutions, and creating data tailored to risk communication and damage assessments will increase the potential for UAS applications to improve the understanding of risks and to reduce those risks associated with abrupt cold region hazards. In the future, cold region applications can benefit from the advances made by these early adopters who have identified exciting new avenues for advancing hazard research via innovative use of both emerging and existing sensors.more » « less
-
An emerging arena of archaeological research is beginning to deploy remote sensing technologies—including aerial and satellite imagery, digital topographic data, and drone-acquired and terrestrial geophysical data—not only in support of conventional fieldwork but also as an independent means of exploring the archaeological landscape. This article provides a critical review of recent research that relies on an ever-growing arsenal of imagery and instruments to undertake innovative investigations: mapping regional-scale settlement histories, documenting ancient land use practices, revealing the complexity of settled spaces, building nuanced pictures of environmental contexts, and monitoring at-risk cultural heritage. At the same time, the disruptive nature of these technologies is generating complex new challenges and controversies surrounding data access and preservation, approaches to a deluge of information, and issues of ethical remote sensing. As we navigate these challenges, remote sensing technologies nonetheless offer revolutionary ways of interrogating the archaeological record and transformative insights into the human past.more » « less
-
null (Ed.)Accurately mapping tree species composition and diversity is a critical step towards spatially explicit and species-specific ecological understanding. The National Ecological Observatory Network (NEON) is a valuable source of open ecological data across the United States. Freely available NEON data include in-situ measurements of individual trees, including stem locations, species, and crown diameter, along with the NEON Airborne Observation Platform (AOP) airborne remote sensing imagery, including hyperspectral, multispectral, and light detection and ranging (LiDAR) data products. An important aspect of predicting species using remote sensing data is creating high-quality training sets for optimal classification purposes. Ultimately, manually creating training data is an expensive and time-consuming task that relies on human analyst decisions and may require external data sets or information. We combine in-situ and airborne remote sensing NEON data to evaluate the impact of automated training set preparation and a novel data preprocessing workflow on classifying the four dominant subalpine coniferous tree species at the Niwot Ridge Mountain Research Station forested NEON site in Colorado, USA. We trained pixel-based Random Forest (RF) machine learning models using a series of training data sets along with remote sensing raster data as descriptive features. The highest classification accuracies, 69% and 60% based on internal RF error assessment and an independent validation set, respectively, were obtained using circular tree crown polygons created with half the maximum crown diameter per tree. LiDAR-derived data products were the most important features for species classification, followed by vegetation indices. This work contributes to the open development of well-labeled training data sets for forest composition mapping using openly available NEON data without requiring external data collection, manual delineation steps, or site-specific parameters.more » « less
-
With the rapid proliferation of small unmanned aircraft systems (UAS), the risk of mid-air collisions is growing, as is the risk associated with the malicious use of these systems. Airborne Detect-and-Avoid (ABDAA) and counter-UAS technologies have similar sensing requirements to detect and track airborne threats, albeit for different purposes: to avoid a collision or to neutralize a threat, respectively. These systems typically include a variety of sensors, such as electro-optical or infrared (EO/IR) cameras, RADAR, or LiDAR, and they fuse the data from these sensors to detect and track a given threat and to predict its trajectory. Camera imagery can be an effective method for detection as well as for pose estimation and threat classification, though a single camera cannot resolve range to a threat without additional information, such as knowledge of the threat geometry. To support ABDAA and counter-UAS applications, we consider a merger of two image-based sensing methods that mimic human vision: (1) a "peripheral vision" camera (i.e., with a fisheye lens) to provide a large field-of-view and (2) a "central vision" camera (i.e., with a perspective lens) to provide high resolution imagery of a specific target. Beyond the complementary ability of the two cameras to support detection and classification, the pair form a heterogeneous stereo vision system that can support range resolution. This paper describes the initial development and testing of a peripheral-central vision system to detect, localize, and classify an airborne threat and finally to predict its path using knowledge of the threat class.more » « less
