skip to main content


Title: An Open-Source Photogrammetry Workflow for Reconstructing 3D Models
Synopsis

Acquiring accurate 3D biological models efficiently and economically is important for morphological data collection and analysis in organismal biology. In recent years, structure-from-motion (SFM) photogrammetry has become increasingly popular in biological research due to its flexibility and being relatively low cost. SFM photogrammetry registers 2D images for reconstructing camera positions as the basis for 3D modeling and texturing. However, most studies of organismal biology still relied on commercial software to reconstruct the 3D model from photographs, which impeded the adoption of this workflow in our field due the blocking issues such as cost and affordability. Also, prior investigations in photogrammetry did not sufficiently assess the geometric accuracy of the models reconstructed. Consequently, this study has two goals. First, we presented an affordable and highly flexible SFM photogrammetry pipeline based on the open-source package OpenDroneMap (ODM) and its user interface WebODM. Second, we assessed the geometric accuracy of the photogrammetric models acquired from the ODM pipeline by comparing them to the models acquired via microCT scanning, the de facto method to image skeleton. Our sample comprised 15 Aplodontia rufa (mountain beaver) skulls. Using models derived from microCT scans of the samples as reference, our results showed that the geometry of the models derived from ODM was sufficiently accurate for gross metric and morphometric analysis as the measurement errors are usually around or below 2%, and morphometric analysis captured consistent patterns of shape variations in both modalities. However, subtle but distinct differences between the photogrammetric and microCT-derived 3D models could affect the landmark placement, which in return affected the downstream shape analysis, especially when the variance within a sample is relatively small. At the minimum, we strongly advise not combining 3D models derived from these two modalities for geometric morphometric analysis. Our findings can be indictive of similar issues in other SFM photogrammetry tools since the underlying pipelines are similar. We recommend that users run a pilot test of geometric accuracy before using photogrammetric models for morphometric analysis. For the research community, we provide detailed guidance on using our pipeline for building 3D models from photographs.

 
more » « less
NSF-PAR ID:
10432543
Author(s) / Creator(s):
;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Integrative Organismal Biology
Volume:
5
Issue:
1
ISSN:
2517-4843
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The evolution of underwater photogrammetry allows to realize 3D models of submerged object and structures throughout the use of rapid and efficient procedures either in terms of data acquisition and data processing. These procedures are based on solutions that are applied using natural control points, signalized markers and tie points; the most common algorithms are based on Structure from Motion (SfM) approach. The limit of these applications is sometimes due to the final accuracy, especially when the goal is a centimeter level of accuracy. This accuracy should be necessary when dealing with a survey devoted to deformation control purposes. An example is the underwater photogrammetry for the determination of coral growth; it is effectively a movement or a deformation detection issue where the geometric change is almost at centimeter or few centimeters accuracy level. When dealing with deformation control applications, a geodetic network is essential to realize a stable and unambiguous reference frame through the accurate and permanent installation of Ground Control Points (GCPs). Such a network, indeed, permits a robust reference frame for the georeferencing of images blocks in the different époques of data acquisition. Therefore, the comparison among subsequent photogrammetric restitutions is based on homogeneous 3D models that have been oriented in the same absolute reference system. The photogrammetric survey is based on a methodological approach especially adapted to underwater biometry (like coral growth determination) and to underwater archaeology. The approach is suitable both for modeling objects of relatively reduced dimensions and for structures with a length of ten meters or more, such as coral barriers, wrecks and long walls. The paper describes underwater photogrammetric surveys on sites at different extensions, the geodetic GCPs reference network installation and measurements (distance and elevation difference observations) as well as preliminary results of the network adjustment. A brief description of image acquisition at a different scales and the resulting 3D model of first campaign are also shown. 
    more » « less
  2. Abstract

    Large‐scale digitization projects such as#ScanAllFishesandoVertare generating high‐resolution microCT scans of vertebrates by the thousands. Data from these projects are shared with the community using aggregate 3D specimen repositories like MorphoSource through various open licenses. We anticipate an explosion of quantitative research in organismal biology with the convergence of available data and the methodologies to analyse them.

    Though the data are available, the road from a series of images to analysis is fraught with challenges for most biologists. It involves tedious tasks of data format conversions, preserving spatial scale of the data accurately, 3D visualization and segmentations, and acquiring measurements and annotations. When scientists use commercial software with proprietary formats, a roadblock for data exchange, collaboration and reproducibility is erected that hurts the efforts of the scientific community to broaden participation in research.

    We developed SlicerMorph as an extension of 3D Slicer, a biomedical visualization and analysis ecosystem with extensive visualization and segmentation capabilities built on proven python‐scriptable open‐source libraries such as Visualization Toolkit and Insight Toolkit. In addition to the core functionalities of Slicer, SlicerMorph provides users with modules to conveniently retrieve open‐access 3D models or import users own 3D volumes, to annotate 3D curve and patch‐based landmarks, generate landmark templates, conduct geometric morphometric analyses of 3D organismal form using both landmark‐driven and landmark‐free approaches, and create 3D animations from their results. We highlight how these individual modules can be tied together to establish complete workflow(s) from image sequence to morphospace. Our software development efforts were supplemented with short courses and workshops that cover the fundamentals of 3D imaging and morphometric analyses as it applies to study of organismal form and shape in evolutionary biology.

    Our goal is to establish a community of organismal biologists centred around Slicer and SlicerMorph to facilitate easy exchange of data and results and collaborations using 3D specimens. Our proposition to our colleagues is that using a common open platform supported by a large user and developer community ensures the longevity and sustainability of the tools beyond the initial development effort.

     
    more » « less
  3. In July and August 2019, two paroxysmal eruptions dramatically changed the morphology of the crater terrace that hosts the active vents of Stromboli volcano (Italy). Here, we document these morphological changes, by using 2259 UAS-derived photographs from eight surveys and Structure-from-Motion (SfM) photogrammetric techniques, resulting in 3D point clouds, orthomosaics, and digital surface models (DSMs) with resolution ranging from 8.1 to 12.4 cm/pixel. We focus on the morphological evolution of volcanic features and volume changes in the crater terrace and the upper part of the underlying slope (Sciara del Fuoco). We identify both crater terrace and lava field variations, with vents shifting up to 47 m and the accumulation of tephra deposits. The maximum elevation changes related to the two paroxysmal eruptions (in between May and September 2019) range from +41.4 to −26.4 m at the lava field and N crater area, respectively. Throughout September 2018–June 2020, the total volume change in the surveyed area was +447,335 m3. Despite Stromboli being one of the best-studied volcanoes worldwide, the UAS-based photogrammetry products of this study provide unprecedented high spatiotemporal resolution observations of its entire summit area, in a period when volcanic activity made the classic field inspections and helicopter overflights too risky. Routinely applied UAS operations represent an effective and evolving tool for volcanic hazard assessment and to support decision-makers involved in volcanic surveillance and civil protection operations. 
    more » « less
  4. null (Ed.)
    Underwater photogrammetry is increasingly being used by marine ecologists because of its ability to produce accurate, spatially detailed, non-destructive measurements of benthic communities, coupled with affordability and ease of use. However, independent quality control, rigorous imaging system set-up, optimal geometry design and a strict modeling of the imaging process are essential to achieving a high degree of measurable accuracy and resolution. If a proper photogrammetric approach that enables the formal description of the propagation of measurement error and modeling uncertainties is not undertaken, statements regarding the statistical significance of the results are limited. In this paper, we tackle these critical topics, based on the experience gained in the Moorea Island Digital Ecosystem Avatar (IDEA) project, where we have developed a rigorous underwater photogrammetric pipeline for coral reef monitoring and change detection. Here, we discuss the need for a permanent, underwater geodetic network, which serves to define a temporally stable reference datum and a check for the time series of photogrammetrically derived three-dimensional (3D) models of the reef structure. We present a methodology to evaluate the suitability of several underwater camera systems for photogrammetric and multi-temporal monitoring purposes and stress the importance of camera network geometry to minimize the deformations of photogrammetrically derived 3D reef models. Finally, we incorporate the measurement and modeling uncertainties of the full photogrammetric process into a simple and flexible framework for detecting statistically significant changes among a time series of models. 
    more » « less
  5. Abstract. Here we describe the curriculum and outcomes from a data-intensivegeomorphic analysis course, “Geoscience Field Issues Using High-ResolutionTopography to Understand Earth Surface Processes”, which pivoted to virtualin 2020 due to the COVID-19 pandemic. The curriculum covers technologies formanual and remotely sensed topographic data methods, including (1) GlobalPositioning Systems and Global Navigation Satellite System (GPS/GNSS)surveys, (2) Structure from Motion (SfM) photogrammetry, and (3) ground-based(terrestrial laser scanning, TLS) and airborne lidar. Course content focuseson Earth-surface process applications but could be adapted for othergeoscience disciplines. Many other field courses were canceled in summer2020, so this course served a broad range of undergraduate and graduatestudents in need of a field course as part of degree or researchrequirements. Resulting curricular materials are available freely within theNational Association of Geoscience Teachers' (NAGT's) “Teaching with Online Field Experiences” collection. Theauthors pre-collected GNSS data, uncrewed-aerial-system-derived (UAS-derived) photographs, and ground-based lidar, which students then used in courseassignments. The course was run over a 2-week period and had synchronousand asynchronous components. Students created SfM models that incorporatedpost-processed GNSS ground control points and created derivative SfM and TLSproducts, including classified point clouds and digital elevation models(DEMs). Students were successfully able to (1) evaluate the appropriatenessof a given survey/data approach given site conditions, (2) assess pros andcons of different data collection and post-processing methods in light offield and time constraints and limitations of each, (3) conduct error andgeomorphic change analysis, and (4) propose or implement a protocol to answera geomorphic question. Overall, our analysis indicates the course had asuccessful implementation that met student needs as well as course-specificand NAGT learning outcomes, with 91 % of students receiving an A, B, or Cgrade. Unexpected outcomes of the course included student self-reflectionand redirection and classmate support through a daily reflection anddiscussion post. Challenges included long hours in front of a computer,computing limitations, and burnout because of the condensed nature of thecourse. Recommended implementation improvements include spreading the courseout over a longer period of time or adopting only part of the course andproviding appropriate computers and technical assistance. This paperand published curricular materials should serve as an implementation andassessment guide for the geoscience community to use in virtual or in-personhigh-resolution topographic data courses that can be adapted for individuallabs or for an entire field or data course. 
    more » « less