skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Automated, high-throughput image calibration for parallel-laser photogrammetry
Parallel-laser photogrammetry is growing in popularity as a way to collect non-invasive body size data from wild mammals. Despite its many appeals, this method requires researchers to hand-measure (i) the pixel distance between the parallel laser spots (inter-laser distance) to produce a scale within the image, and (ii) the pixel distance between the study subject’s body landmarks (inter-landmark distance). This manual effort is time-consuming and introduces human error: a researcher measuring the same image twice will rarely return the same values both times (resulting in within-observer error), as is also the case when two researchers measure the same image (resulting in between-observer error). Here, we present two independent methods that automate the inter-laser distance measurement of parallel-laser photogrammetry images. One method uses machine learning and image processing techniques in Python, and the other uses image processing techniques in ImageJ. Both of these methods reduce labor and increase precision without sacrificing accuracy. We first introduce the workflow of the two methods. Then, using two parallel-laser datasets of wild mountain gorilla and wild savannah baboon images, we validate the precision of these two automated methods relative to manual measurements and to each other. We also estimate the reduction of variation in final body size estimates in centimeters when adopting these automated methods, as these methods have no human error. Finally, we highlight the strengths of each method, suggest best practices for adopting either of them, and propose future directions for the automation of parallel-laser photogrammetry data.  more » « less
Award ID(s):
1753651
PAR ID:
10321226
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Mammalian Biology
ISSN:
1616-5047
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Parallel laser photogrammetry (PLP), which consists of attaching two or three parallel laser beams at a known inter‐beam distance to a camera, can be used to collect morphological measurements of organisms noninvasively. The lasers project onto the photo being taken, and because the inter‐beam distance is known, they act as a scale for image analysis programs like ImageJ. Traditionally, this method has been used to measure larger morphological traits (e.g., limb length, crown‐rump length) to serve as proxies for overall body size, whereas applications to smaller anatomical features remain limited. To that end, we used PLP to measure the testes of 18 free‐living mantled howler monkeys (Alouatta palliata)at La Selva Biological Station, Costa Rica. We tested whether this method could reliably measure this relatively small and globular morphology, and whether it could detect differences among individuals. We tested reliability in three ways: within‐photo (coefficient of variation [CV] = 4.7%), between‐photo (CV = 5.5%), and interobserver (intraclass correlation = 0.92). We found an average volume of 36.2 cm3and a range of 16.4–54.4 cm3, indicating variation in testes size between individuals. Furthermore, these sizes are consistent with a previous study that collected measurements by hand, suggesting that PLP is a useful method for making noninvasive measurements of testes. 
    more » « less
  2. Training a deep learning model with a large annotated dataset is still a dominant paradigm in automatic whole slide images (WSIs) processing for digital pathology. However, obtaining manual annotations is a labor-intensive task, and an error-prone to inter and intra-observer variability. In this study, we offer an online deep learning-based clustering workflow for annotating and analysis of different types of tissues from histopathology images. Inspired by learning and optimal transport theory, our proposed model consists of two stages. In the first stage, our model learns tissue-specific discriminative representations by contrasting the features in the latent space at two levels, the instance- and the clusterlevel. This is done by maximizing the similarities of the projections of positive pairs (views of the same image) while minimizing those of negative ones (views of the rest of the images). In the second stage, our framework extends the standard cross-entropy minimization to an optimal transport problem and solves it using the Sinkhorn-Knopp algorithm to produce the cluster assignments. Moreover, our proposed method enforces consistency between the produced assignments obtained from views of the same image. Our framework was evaluated on three common histopathological datasets: NCT-CRC, LC2500, and Kather STAD. Experiments show that our proposed framework can identify different tissues in annotation-free conditions with competitive results. It achieved an accuracy of 0.9364 in human lung patched WSIs and 0.8464 in images of human colorectal tissues outperforming state of the arts contrastive-based methods. 
    more » « less
  3. Abstract As camera trapping has become a standard practice in wildlife ecology, developing techniques to extract additional information from images will increase the utility of generated data. Despite rapid advancements in camera trapping practices, methods for estimating animal size or distance from the camera using captured images have not been standardized. Deriving animal sizes directly from images creates opportunities to collect wildlife metrics such as growth rates or changes in body condition. Distances to animals may be used to quantify important aspects of sampling design such as the effective area sampled or distribution of animals in the camera's field‐of‐view.We present a method of using pixel measurements in an image to estimate animal size or distance from the camera using a conceptual model in photogrammetry known as the ‘pinhole camera model’. We evaluated the performance of this approach both using stationary three‐dimensional animal targets and in a field setting using live captive reindeerRangifer tarandusranging in size and distance from the camera.We found total mean relative error of estimated animal sizes or distances from the cameras in our simulation was −3.0% and 3.3% and in our field setting was −8.6% and 10.5%, respectively. In our simulation, mean relative error of size or distance estimates were not statistically different between image settings within camera models, between camera models or between the measured dimension used in calculations.We provide recommendations for applying the pinhole camera model in a wildlife camera trapping context. Our approach of using the pinhole camera model to estimate animal size or distance from the camera produced robust estimates using a single image while remaining easy to implement and generalizable to different camera trap models and installations, thus enhancing its utility for a variety of camera trap applications and expanding opportunities to use camera trap images in novel ways. 
    more » « less
  4. Abstract Imagery from drones is becoming common in wildlife research and management, but processing data efficiently remains a challenge. We developed a methodology for training a convolutional neural network model on large-scale mosaic imagery to detect and count caribou (Rangifer tarandus), compare model performance with an experienced observer and a group of naïve observers, and discuss the use of aerial imagery and automated methods for large mammal surveys. Combining images taken at 75 m and 120 m above ground level, a faster region-based convolutional neural network (Faster-RCNN) model was trained in using annotated imagery with the labels: “adult caribou”, “calf caribou”, and “ghost caribou” (animals moving between images, producing blurring individuals during the photogrammetry processing). Accuracy, precision, and recall of the model were 80%, 90%, and 88%, respectively. Detections between the model and experienced observer were highly correlated (Pearson: 0.96–0.99,Pvalue < 0.05). The model was generally more effective in detecting adults, calves, and ghosts than naïve observers at both altitudes. We also discuss the need to improve consistency of observers’ annotations if manual review will be used to train models accurately. Generalization of automated methods for large mammal detections will be necessary for large-scale studies with diverse platforms, airspace restrictions, and sensor capabilities. 
    more » « less
  5. Abstract ObjectivesLaboratory studies have yielded important insights into primate locomotor mechanics. Nevertheless, laboratory studies fail to capture the range of ecological and structural variation encountered by free‐ranging primates. We present techniques for collecting kinematic data on wild primates using consumer grade high‐speed cameras and demonstrate novel methods for quantifying metric variation in arboreal substrates. Materials and methodsThese methods were developed and applied to our research examining platyrrhine substrate use and locomotion at the Tiputini Biodiversity Station, Ecuador. Modified GoPro cameras equipped with varifocal zoom lenses provided high‐resolution footage (1080 p.; 120 fps) suitable for digitizing gait events. We tested two methods for remotely measuring branch diameter: the parallel laser method and the distance meter photogrammetric method. A forestry‐grade laser rangefinder was used to quantify substrate angle and a force gauge was used to measure substrate compliance. We also introduce GaitKeeper, a graphical user interface for MATLAB, designed for coding quadrupedal gait. ResultsParallel laser and distance meter methods provided accurate estimations of substrate diameter (percent error: 3.1–4.5%). The laser rangefinder yielded accurate estimations of substrate orientation (mean error = 2.5°). Compliance values varied tremendously among substrates but were largely explained by substrate diameter, substrate length, and distance of measurement point from trunk. On average, larger primates used relatively small substrates and traveled higher in the canopy. DiscussionUltimately, these methods will help researchers identify more precisely how primate gait kinematics respond to the complexity of arboreal habitats, furthering our understanding of the adaptive context in which primate quadrupedalism evolved. 
    more » « less