skip to main content


Title: An Open-Source Photogrammetry Workflow for Reconstructing 3D Models
Synopsis

Acquiring accurate 3D biological models efficiently and economically is important for morphological data collection and analysis in organismal biology. In recent years, structure-from-motion (SFM) photogrammetry has become increasingly popular in biological research due to its flexibility and being relatively low cost. SFM photogrammetry registers 2D images for reconstructing camera positions as the basis for 3D modeling and texturing. However, most studies of organismal biology still relied on commercial software to reconstruct the 3D model from photographs, which impeded the adoption of this workflow in our field due the blocking issues such as cost and affordability. Also, prior investigations in photogrammetry did not sufficiently assess the geometric accuracy of the models reconstructed. Consequently, this study has two goals. First, we presented an affordable and highly flexible SFM photogrammetry pipeline based on the open-source package OpenDroneMap (ODM) and its user interface WebODM. Second, we assessed the geometric accuracy of the photogrammetric models acquired from the ODM pipeline by comparing them to the models acquired via microCT scanning, the de facto method to image skeleton. Our sample comprised 15 Aplodontia rufa (mountain beaver) skulls. Using models derived from microCT scans of the samples as reference, our results showed that the geometry of the models derived from ODM was sufficiently accurate for gross metric and morphometric analysis as the measurement errors are usually around or below 2%, and morphometric analysis captured consistent patterns of shape variations in both modalities. However, subtle but distinct differences between the photogrammetric and microCT-derived 3D models could affect the landmark placement, which in return affected the downstream shape analysis, especially when the variance within a sample is relatively small. At the minimum, we strongly advise not combining 3D models derived from these two modalities for geometric morphometric analysis. Our findings can be indictive of similar issues in other SFM photogrammetry tools since the underlying pipelines are similar. We recommend that users run a pilot test of geometric accuracy before using photogrammetric models for morphometric analysis. For the research community, we provide detailed guidance on using our pipeline for building 3D models from photographs.

 
more » « less
Award ID(s):
2118240
PAR ID:
10432543
Author(s) / Creator(s):
;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Integrative Organismal Biology
Volume:
5
Issue:
1
ISSN:
2517-4843
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The evolution of underwater photogrammetry allows to realize 3D models of submerged object and structures throughout the use of rapid and efficient procedures either in terms of data acquisition and data processing. These procedures are based on solutions that are applied using natural control points, signalized markers and tie points; the most common algorithms are based on Structure from Motion (SfM) approach. The limit of these applications is sometimes due to the final accuracy, especially when the goal is a centimeter level of accuracy. This accuracy should be necessary when dealing with a survey devoted to deformation control purposes. An example is the underwater photogrammetry for the determination of coral growth; it is effectively a movement or a deformation detection issue where the geometric change is almost at centimeter or few centimeters accuracy level. When dealing with deformation control applications, a geodetic network is essential to realize a stable and unambiguous reference frame through the accurate and permanent installation of Ground Control Points (GCPs). Such a network, indeed, permits a robust reference frame for the georeferencing of images blocks in the different époques of data acquisition. Therefore, the comparison among subsequent photogrammetric restitutions is based on homogeneous 3D models that have been oriented in the same absolute reference system. The photogrammetric survey is based on a methodological approach especially adapted to underwater biometry (like coral growth determination) and to underwater archaeology. The approach is suitable both for modeling objects of relatively reduced dimensions and for structures with a length of ten meters or more, such as coral barriers, wrecks and long walls. The paper describes underwater photogrammetric surveys on sites at different extensions, the geodetic GCPs reference network installation and measurements (distance and elevation difference observations) as well as preliminary results of the network adjustment. A brief description of image acquisition at a different scales and the resulting 3D model of first campaign are also shown. 
    more » « less
  2. Abstract

    Large‐scale digitization projects such as#ScanAllFishesandoVertare generating high‐resolution microCT scans of vertebrates by the thousands. Data from these projects are shared with the community using aggregate 3D specimen repositories like MorphoSource through various open licenses. We anticipate an explosion of quantitative research in organismal biology with the convergence of available data and the methodologies to analyse them.

    Though the data are available, the road from a series of images to analysis is fraught with challenges for most biologists. It involves tedious tasks of data format conversions, preserving spatial scale of the data accurately, 3D visualization and segmentations, and acquiring measurements and annotations. When scientists use commercial software with proprietary formats, a roadblock for data exchange, collaboration and reproducibility is erected that hurts the efforts of the scientific community to broaden participation in research.

    We developed SlicerMorph as an extension of 3D Slicer, a biomedical visualization and analysis ecosystem with extensive visualization and segmentation capabilities built on proven python‐scriptable open‐source libraries such as Visualization Toolkit and Insight Toolkit. In addition to the core functionalities of Slicer, SlicerMorph provides users with modules to conveniently retrieve open‐access 3D models or import users own 3D volumes, to annotate 3D curve and patch‐based landmarks, generate landmark templates, conduct geometric morphometric analyses of 3D organismal form using both landmark‐driven and landmark‐free approaches, and create 3D animations from their results. We highlight how these individual modules can be tied together to establish complete workflow(s) from image sequence to morphospace. Our software development efforts were supplemented with short courses and workshops that cover the fundamentals of 3D imaging and morphometric analyses as it applies to study of organismal form and shape in evolutionary biology.

    Our goal is to establish a community of organismal biologists centred around Slicer and SlicerMorph to facilitate easy exchange of data and results and collaborations using 3D specimens. Our proposition to our colleagues is that using a common open platform supported by a large user and developer community ensures the longevity and sustainability of the tools beyond the initial development effort.

     
    more » « less
  3. null (Ed.)
    Underwater photogrammetry is increasingly being used by marine ecologists because of its ability to produce accurate, spatially detailed, non-destructive measurements of benthic communities, coupled with affordability and ease of use. However, independent quality control, rigorous imaging system set-up, optimal geometry design and a strict modeling of the imaging process are essential to achieving a high degree of measurable accuracy and resolution. If a proper photogrammetric approach that enables the formal description of the propagation of measurement error and modeling uncertainties is not undertaken, statements regarding the statistical significance of the results are limited. In this paper, we tackle these critical topics, based on the experience gained in the Moorea Island Digital Ecosystem Avatar (IDEA) project, where we have developed a rigorous underwater photogrammetric pipeline for coral reef monitoring and change detection. Here, we discuss the need for a permanent, underwater geodetic network, which serves to define a temporally stable reference datum and a check for the time series of photogrammetrically derived three-dimensional (3D) models of the reef structure. We present a methodology to evaluate the suitability of several underwater camera systems for photogrammetric and multi-temporal monitoring purposes and stress the importance of camera network geometry to minimize the deformations of photogrammetrically derived 3D reef models. Finally, we incorporate the measurement and modeling uncertainties of the full photogrammetric process into a simple and flexible framework for detecting statistically significant changes among a time series of models. 
    more » « less
  4. Unsupervised machine learning algorithms (clustering, genetic, and principal component analysis) automate Unmanned Aerial Vehicle (UAV) missions as well as the creation and refinement of iterative 3D photogrammetric models with a next best view (NBV) approach. The novel approach uses Structure-from-Motion (SfM) to achieve convergence to a specified orthomosaic resolution by identifying edges in the point cloud and planning cameras that “view” the holes identified by edges without requiring an initial model. This iterative UAV photogrammetric method successfully runs in various Microsoft AirSim environments. Simulated ground sampling distance (GSD) of models reaches as low as 3.4 cm per pixel, and generally, successive iterations improve resolution. Besides analogous application in simulated environments, a field study of a retired municipal water tank illustrates the practical application and advantages of automated UAV iterative inspection of infrastructure using 63 % fewer photographs than a comparable manual flight with analogous density point clouds obtaining a GSD of less than 3 cm per pixel. Each iteration qualitatively increases resolution according to a logarithmic regression, reduces holes in models, and adds details to model edges. 
    more » « less
  5. In July and August 2019, two paroxysmal eruptions dramatically changed the morphology of the crater terrace that hosts the active vents of Stromboli volcano (Italy). Here, we document these morphological changes, by using 2259 UAS-derived photographs from eight surveys and Structure-from-Motion (SfM) photogrammetric techniques, resulting in 3D point clouds, orthomosaics, and digital surface models (DSMs) with resolution ranging from 8.1 to 12.4 cm/pixel. We focus on the morphological evolution of volcanic features and volume changes in the crater terrace and the upper part of the underlying slope (Sciara del Fuoco). We identify both crater terrace and lava field variations, with vents shifting up to 47 m and the accumulation of tephra deposits. The maximum elevation changes related to the two paroxysmal eruptions (in between May and September 2019) range from +41.4 to −26.4 m at the lava field and N crater area, respectively. Throughout September 2018–June 2020, the total volume change in the surveyed area was +447,335 m3. Despite Stromboli being one of the best-studied volcanoes worldwide, the UAS-based photogrammetry products of this study provide unprecedented high spatiotemporal resolution observations of its entire summit area, in a period when volcanic activity made the classic field inspections and helicopter overflights too risky. Routinely applied UAS operations represent an effective and evolving tool for volcanic hazard assessment and to support decision-makers involved in volcanic surveillance and civil protection operations. 
    more » « less