skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on August 1, 2026

Title: Automated extraction of right whale morphometric data from drone aerial photographs
Abstract Aerial photogrammetry is a popular non‐invasive tool to measure the size, body morphometrics and body condition of wild animals. While the method can generate large datasets quickly, the lack of efficient processing tools can create bottlenecks that delay management actions. We developed a machine learning algorithm to automatically measure body morphometrics (body length and widths) of southern right whales (Eubalaena australis, SRWs) from aerial photographs (n = 8,958) collected by unmanned aerial vehicles in Australia. Our approach utilizes two Mask R‐CNN detection models to: (i) generate masks for each whale and (ii) estimate points along the whale's axis. We annotated a dataset of 468 images containing 638 whales to train our models. To evaluate the accuracy of our machine learning approach, we compared the model‐generated body morphometrics to manual measurements. The influence of picture quality (whale posture and water clarity) was also assessed. The model‐generated body length estimates were slightly negatively biased (median error of −1.3%), whereas the body volume estimates had a small (median error of 6.5%) positive bias. After correcting both biases, the resulting model‐generated body length and volume estimates had mean absolute errors of 0.85% (SD = 0.75) and 6.88% (SD = 6.57), respectively. The magnitude of the errors decreased as picture quality increased. When using the model‐generated data to quantify intra‐seasonal changes in body condition of SRW females, we obtained a similar slope parameter (−0.001843, SE = 0.000095) as derived from manual measurements (−0.001565, SE = 0.000079). This indicates that our approach was able to accurately capture temporal trends in body condition at a population level.  more » « less
Award ID(s):
2329927
PAR ID:
10635779
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Wiley
Date Published:
Journal Name:
Remote Sensing in Ecology and Conservation
Volume:
11
Issue:
4
ISSN:
2056-3485
Page Range / eLocation ID:
438 to 453
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Body condition is a crucial and indicative measure of an animal’s fitness, reflecting overall foraging success, habitat quality, and balance between energy intake and energetic investment toward growth, maintenance, and reproduction. Recently, drone-based photogrammetry has provided new opportunities to obtain body condition estimates of baleen whales in one, two or three dimensions (1D, 2D, and 3D, respectively) – a single width, a projected dorsal surface area, or a body volume measure, respectively. However, no study to date has yet compared variation among these methods and described how measurement uncertainty scales across these dimensions. This associated uncertainty may affect inference derived from these measurements, which can lead to misinterpretation of data, and lack of comparison across body condition measurements restricts comparison of results between studies. Here we develop a Bayesian statistical model using known-sized calibration objects to predict the length and width measurements of unknown-sized objects (e.g., a whale). We use the fitted model to predict and compare uncertainty associated with 1D, 2D, and 3D photogrammetry-based body condition measurements of blue, humpback, and Antarctic minke whales – three species of baleen whales with a range of body sizes. The model outputs a posterior predictive distribution of body condition measurements and allows for the construction of highest posterior density intervals to define measurement uncertainty. We find that uncertainty does not scale linearly across multi-dimensional measurements, with 2D and 3D uncertainty increasing by a factor of 1.45 and 1.76 compared to 1D, respectively. Each standardized body condition measurement is highly correlated with one another, yet 2D body area index (BAI) accounts for potential variation along the body for each species and was the most precise body condition metric. We hope this study will serve as a guide to help researchers select the most appropriate body condition measurement for their purposes and allow them to incorporate photogrammetric uncertainty associated with these measurements which, in turn, will facilitate comparison of results across studies. 
    more » « less
  2. The considerable power needed for large whales to leap out of the water may represent the single most expensive burst maneuver found in nature. However, the mechanics and energetic costs associated with the breaching behaviors of large whales remain poorly understood. In this study we deployed whale-borne tags to measure the kinematics of breaching to test the hypothesis that these spectacular aerial displays are metabolically expensive. We found that breaching whales use variable underwater trajectories, and that high-emergence breaches are faster and require more energy than predatory lunges. The most expensive breaches approach the upper limits of vertebrate muscle performance, and the energetic cost of breaching is high enough that repeated breaching events may serve as honest signaling of body condition. Furthermore, the confluence of muscle contractile properties, hydrodynamics, and the high speeds required likely impose an upper limit to the body size and effectiveness of breaching whales. 
    more » « less
  3. Increasingly, drone-based photogrammetry has been used to measure size and body condition changes in marine megafauna. A broad range of platforms, sensors, and altimeters are being applied for these purposes, but there is no unified way to predict photogrammetric uncertainty across this methodological spectrum. As such, it is difficult to make robust comparisons across studies, disrupting collaborations amongst researchers using platforms with varying levels of measurement accuracy. Here we built off previous studies quantifying uncertainty and used an experimental approach to train a Bayesian statistical model using a known-sized object floating at the water’s surface to quantify how measurement error scales with altitude for several different drones equipped with different cameras, focal length lenses, and altimeters. We then applied the fitted model to predict the length distributions and estimate age classes of unknown-sized humpback whales Megaptera novaeangliae , as well as to predict the population-level morphological relationship between rostrum to blowhole distance and total body length of Antarctic minke whales Balaenoptera bonaerensis . This statistical framework jointly estimates errors from altitude and length measurements from multiple observations and accounts for altitudes measured with both barometers and laser altimeters while incorporating errors specific to each. This Bayesian model outputs a posterior predictive distribution of measurement uncertainty around length measurements and allows for the construction of highest posterior density intervals to define measurement uncertainty, which allows one to make probabilistic statements and stronger inferences pertaining to morphometric features critical for understanding life history patterns and potential impacts from anthropogenically altered habitats. 
    more » « less
  4. High efficiency lunate-tail swimming with high-aspect-ratio lifting surfaces has evolved in many vertebrate lineages, from fish to cetaceans. Baleen whales (Mysticeti) are the largest swimming animals that exhibit this locomotor strategy, and present an ideal study system to examine how morphology and the kinematics of swimming scale to the largest body sizes. We used data from whale-borne inertial sensors coupled with morphometric measurements from aerial drones to calculate the hydrodynamic performance of oscillatory swimming in six baleen whale species ranging in body length from 5 to 25 m (fin whale, Balaenoptera physalus; Bryde’s whale, Balaenoptera edeni; sei whale, Balaenoptera borealis; Antarctic minke whale, Balaenoptera bonaerensis; humpback whale, Megaptera novaeangliae; and blue whale, Balaenoptera musculus). We found that mass-specific thrust increased with both swimming speed and body size. Froude efficiency, defined as the ratio of useful power output to the rate of energy input (Sloop, 1978), generally increased with swimming speed but decreased on average with increasing body size. This finding is contrary to previous results in smaller animals, where Froude efficiency increased with body size. Although our empirically parameterized estimates for swimming baleen whale drag were higher than those of a simple gliding model, oscillatory locomotion at this scale exhibits generally high Froude efficiency as in other adept swimmers. Our results quantify the fine- scale kinematics and estimate the hydrodynamics of routine and energetically expensive swimming modes at the largest scale. 
    more » « less
  5. Despite their enormous size, whales make their living as voracious predators. To catch their much smaller, more maneuverable prey, they have developed several unique locomotor strategies that require high energetic input, high mechanical power output and a surprising degree of agility. To better understand how body size affects maneuverability at the largest scale, we used bio-logging data, aerial photogrammetry and a high-throughput approach to quantify the maneuvering performance of seven species of free-swimming baleen whale. We found that as body size increases, absolute maneuvering performance decreases: larger whales use lower accelerations and perform slower pitch-changes, rolls and turns than smaller species. We also found that baleen whales exhibit positive allometry of maneuvering performance: relative to their body size, larger whales use higher accelerations, and perform faster pitch- changes, rolls and certain types of turns than smaller species. However, not all maneuvers were impacted by body size in the same way, and we found that larger whales behaviorally adjust for their decreased agility by using turns that they can perform more effectively. The positive allometry of maneuvering performance suggests that large whales have compensated for their increased body size by evolving more effective control surfaces and by preferentially selecting maneuvers that play to their strengths. 
    more » « less