Title: A sensor-based calibration system for three-dimensional digital image correlation
Three-dimensional digital image correlation (3D-DIC) has become a strong alternative to traditional contact-based techniques for structural health monitoring. 3D-DIC can extract the full-field displacement of a structure from a set of synchronized stereo images. Before performing 3D-DIC, a complex calibration process must be completed to obtain the stereovision system’s extrinsic parameters (i.e., cameras’ distance and orientation). The time required for the calibration depends on the dimensions of the targeted structure. For example, for large-scale structures, the calibration may take several hours. Furthermore, every time the cameras’ position changes, a new calibration is required to recalculate the extrinsic parameters. The approach proposed in this research allows determining the 3D-DIC extrinsic parameters using the data measured with commercially available sensors. The system utilizes three Inertial Measurement Units with a laser distance meter to compute the relative orientation and distance between the cameras. In this paper, an evaluation of the sensitivity of the newly developed sensor suite is provided by assessing the errors in the measurement of the extrinsic parameters. Analytical simulations performed on a 7.5 x 5.7 m field of view using the data retrieved from the sensors show that the proposed approach provides an accuracy of ~10-6 m and a promising way to reduce the complexity of 3D-DIC calibration.  more » « less
Award ID(s):
2018992
PAR ID:
10351311
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Fromme, Paul; Su, Zhongqing
Date Published:
Journal Name:
Health Monitoring of Structural and Biological Systems XVI
Page Range / eLocation ID:
54
Subject(s) / Keyword(s):
Sponsoring Org:
National Science Foundation
More Like this
  1. Fromme, Paul; Su, Zhongqing (Ed.)
    Stereovision systems can extract full-field three-dimensional (3D) displacements of structures by processing the images collected with two synchronized cameras. To obtain accurate measurements, the cameras must be calibrated to account for lens distortion (i.e., intrinsic parameters) and compute the cameras’ relative position and orientation (i.e., extrinsic parameters). Traditionally, calibration is performed by taking photos of a calibration object (e.g., a checkerboard) with the two cameras. Because the calibration object must be similar in size to the targeted structure, measurements on large-scale structures are highly impractical. This research proposes a multi-sensor board with three inertial measurement units and a laser distance meter to compute the extrinsic parameters of a stereovision system and streamline the calibration procedure. In this paper, the performances of the proposed sensor-based calibration are compared with the accuracy of the traditional image-based calibration procedure. Laboratory experiments show that cameras calibrated with the multi-sensor board measure displacements with 95% accuracy compared to displacements obtained from cameras calibrated with the traditional procedure. The results of this study indicate that the sensor-based approach can increase the applicability of 3D digital image correlation measurements to large-scale structures while reducing the time and complexity of the calibration. 
    more » « less
  2. Sara, Gonizzi Barsanti (Ed.)
    Computer vision techniques such as three-dimensional digital image correlation (3D-DIC) and three-dimensional point tracking (3D-PT) have demonstrated broad applicability for monitoring the conditions of large-scale engineering systems by reconstructing and tracking dynamic point clouds corresponding to the surface of a structure. Accurate stereophotogrammetry measurements require the stereo cameras to be calibrated to determine their intrinsic and extrinsic parameters by capturing multiple images of a calibration object. This image-based approach becomes cumbersome and time-consuming as the size of the tested object increases. To streamline the calibration and make it scale-insensitive, a multi-sensor system embedding inertial measurement units and a laser sensor is developed to compute the extrinsic parameters of the stereo cameras. In this research, the accuracy of the proposed sensor-based calibration method in performing stereophotogrammetry is validated experimentally and compared with traditional approaches. Tests conducted at various scales reveal that the proposed sensor-based calibration enables reconstructing both static and dynamic point clouds, measuring displacements with an accuracy higher than 95% compared to image-based traditional calibration, while being up to an order of magnitude faster and easier to deploy. The novel approach has broad applications for making static, dynamic, and deformation measurements to transform how large-scale structural health monitoring can be performed. 
    more » « less
  3. Three-dimensional point tracking (3D-PT) and three-dimensional digital image correlation (3D-DIC) have emerged as powerful non-contact techniques for measuring displacements and deformations in structural health monitoring (SHM) applications. However, their deployment is typically limited to small-to-medium fields of view and requires stereo cameras to be rigidly mounted and pre-calibrated using cumbersome procedures. These constraints hinder their use in large-scale or remote environments where installing calibration targets and maintaining fixed baselines is impractical. This study analyzes the feasibility of a novel hybrid calibration method for two cameras mounted on two independently hovering unmanned aerial vehicles (UAVs) (i.e., one camera per UAV). The proposed approach integrates global navigation satellite system (GNSS) and inertial measurement unit (IMU) data to dynamically compute the extrinsic parameters of two UAV-mounted cameras, eliminating the need for rigid mounts and oversized calibration objects. To address issues of sensor desynchronization and UAV oscillations, a homography-based motion compensation algorithm is used, allowing for accurate triangulation even under flight-induced disturbances. The method is validated through three field tests, including static and dynamic scenarios, and benchmarked against a ground-based stereo camera system. Results demonstrate centimeter-level tracking accuracy and a displacement error of less than 1% compared to stationary references, despite the desynchronization issues between the different sensors encountered in this study. The results of this work demonstrate the feasibility of the proposed concept. Once the desynchronization issues highlighted in this study are addressed, the proposed hybrid stereocamera calibration method has the potential to enable scalable and high-accuracy 3D measurements for SHM and structural dynamic measurements of large-scale infrastructure. 
    more » « less
  4. We present a novel approach for the radiometric calibration of phase-measuring 3D sensors. Our approach can be applied to a broad variety of scenes and calculates the calibration parameters “on-the-fly” from the actual object measurement images, meaning that no additional calibration session is required. 
    more » « less
  5. Robust and effective fruit detection and localization is essential for robotic harvesting systems. While extensive research efforts have been devoted to improving fruit detection, less emphasis has been placed on the fruit localization aspect, which is a crucial yet challenging task due to limited depth accuracy from existing sensor measurements in the natural orchard environment with variable lighting conditions and foliage/branch occlusions. In this paper, we present the system design and calibration of an Active LAser-Camera Scanner (ALACS), a novel perception module for robust and high-precision fruit localization. The hardware of the ALACS mainly consists of a red line laser, an RGB camera, and a linear motion slide, which are seamlessly integrated into an active scanning scheme where a dynamic-targeting laser-triangulation principle is employed. A high-fidelity extrinsic model is developed to pair the laser illumination and the RGB camera, enabling precise depth computation when the target is captured by both sensors. A random sample consensus-based robust calibration scheme is then designed to calibrate the model parameters based on collected data. Comprehensive evaluations are conducted to validate the system model and calibration scheme. The results show that the proposed calibration method can detect and remove data outliers to achieve robust parameter computation, and the calibrated ALACS system is able to achieve high-precision localization with the maximum depth measurement error being less than 4 mm at distance ranging from 0.6 to 1.2 m. 
    more » « less