skip to main content


Title: A sensor-based calibration system for three-dimensional digital image correlation
Three-dimensional digital image correlation (3D-DIC) has become a strong alternative to traditional contact-based techniques for structural health monitoring. 3D-DIC can extract the full-field displacement of a structure from a set of synchronized stereo images. Before performing 3D-DIC, a complex calibration process must be completed to obtain the stereovision system’s extrinsic parameters (i.e., cameras’ distance and orientation). The time required for the calibration depends on the dimensions of the targeted structure. For example, for large-scale structures, the calibration may take several hours. Furthermore, every time the cameras’ position changes, a new calibration is required to recalculate the extrinsic parameters. The approach proposed in this research allows determining the 3D-DIC extrinsic parameters using the data measured with commercially available sensors. The system utilizes three Inertial Measurement Units with a laser distance meter to compute the relative orientation and distance between the cameras. In this paper, an evaluation of the sensitivity of the newly developed sensor suite is provided by assessing the errors in the measurement of the extrinsic parameters. Analytical simulations performed on a 7.5 x 5.7 m field of view using the data retrieved from the sensors show that the proposed approach provides an accuracy of ~10-6 m and a promising way to reduce the complexity of 3D-DIC calibration.  more » « less
Award ID(s):
2018992
NSF-PAR ID:
10351311
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Fromme, Paul; Su, Zhongqing
Date Published:
Journal Name:
Health Monitoring of Structural and Biological Systems XVI
Page Range / eLocation ID:
54
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Fromme, Paul ; Su, Zhongqing (Ed.)
    Stereovision systems can extract full-field three-dimensional (3D) displacements of structures by processing the images collected with two synchronized cameras. To obtain accurate measurements, the cameras must be calibrated to account for lens distortion (i.e., intrinsic parameters) and compute the cameras’ relative position and orientation (i.e., extrinsic parameters). Traditionally, calibration is performed by taking photos of a calibration object (e.g., a checkerboard) with the two cameras. Because the calibration object must be similar in size to the targeted structure, measurements on large-scale structures are highly impractical. This research proposes a multi-sensor board with three inertial measurement units and a laser distance meter to compute the extrinsic parameters of a stereovision system and streamline the calibration procedure. In this paper, the performances of the proposed sensor-based calibration are compared with the accuracy of the traditional image-based calibration procedure. Laboratory experiments show that cameras calibrated with the multi-sensor board measure displacements with 95% accuracy compared to displacements obtained from cameras calibrated with the traditional procedure. The results of this study indicate that the sensor-based approach can increase the applicability of 3D digital image correlation measurements to large-scale structures while reducing the time and complexity of the calibration. 
    more » « less
  2. Evolution has honed predatory skills in the natural world where localizing and intercepting fast-moving prey is required. The current generation of robotic systems mimics these biological systems using deep learning. High-speed processing of the camera frames using convolutional neural networks (CNN) (frame pipeline) on such constrained aerial edge-robots gets resource-limited. Adding more compute resources also eventually limits the throughput at the frame rate of the camera as frame-only traditional systems fail to capture the detailed temporal dynamics of the environment. Bio-inspired event cameras and spiking neural networks (SNN) provide an asynchronous sensor-processor pair (event pipeline) capturing the continuous temporal details of the scene for high-speed but lag in terms of accuracy. In this work, we propose a target localization system combining event-camera and SNN-based high-speed target estimation and frame-based camera and CNN-driven reliable object detection by fusing complementary spatio-temporal prowess of event and frame pipelines. One of our main contributions involves the design of an SNN filter that borrows from the neural mechanism for ego-motion cancelation in houseflies. It fuses the vestibular sensors with the vision to cancel the activity corresponding to the predator's self-motion. We also integrate the neuro-inspired multi-pipeline processing with task-optimized multi-neuronal pathway structure in primates and insects. The system is validated to outperform CNN-only processing using prey-predator drone simulations in realistic 3D virtual environments. The system is then demonstrated in a real-world multi-drone set-up with emulated event data. Subsequently, we use recorded actual sensory data from multi-camera and inertial measurement unit (IMU) assembly to show desired working while tolerating the realistic noise in vision and IMU sensors. We analyze the design space to identify optimal parameters for spiking neurons, CNN models, and for checking their effect on the performance metrics of the fused system. Finally, we map the throughput controlling SNN and fusion network on edge-compatible Zynq-7000 FPGA to show a potential 264 outputs per second even at constrained resource availability. This work may open new research directions by coupling multiple sensing and processing modalities inspired by discoveries in neuroscience to break fundamental trade-offs in frame-based computer vision 1 . 
    more » « less
  3. This work focuses on finding the extrinsic parameters (rotation and translation) between the lidar and the stereo camera setups. We use a planar checkerboard and place it inside the Field-of-View (FOV) of both the sensors, where we extract the 3D plane information of the checkerboard acquired from the sensor’s data. The planes extracted from the sensor’s data are used as reference data sets to find the relative transformation between the two sensors. We use our proposed method Correntropy Similarity Matrix Iterative Closest Point (CoSM-ICP) algorithm to estimate the relative transformation. In this work, we use a single frame of the point cloud data acquired from the lidar sensor and a single frame from the calibrated Stereo camera point cloud to perform this operation. We evaluate our approach on a simulated dataset since it has the freedom to evaluate under multiple configurations. Through results, we verify our approach under various configurations. 
    more » « less
  4. Hydrogels are a class of soft, highly deformable materials formed by swelling a network of polymer chains in water. With mechanical properties that mimic biological materials, hydrogels are often proposed for load bearing biomedical or other applications in which their deformation and failure properties will be important. To study the failure of such materials a means for the measurement of deformation fields beyond simple uniaxial tension tests is required. As a non-contact, full-field deformation measurement method, Digital Image Correlation (DIC) is a good candidate for such studies. The application of DIC to hydrogels is studied here with the goal of establishing the accuracy of DIC when applied to hydrogels in the presence of large strains and large strain gradients. Experimental details such as how to form a durable speckle pattern on a material that is 90% water are discussed. DIC is used to measure the strain field in tension loaded samples containing a central hole, a circular edge notch and a sharp crack. Using a nonlinear, large deformation constitutive model, these experiments are modeled using the finite element method (FEM). Excellent agreement between FEM and DIC results for all three geometries shows that the DIC measurements are accurate up to strains of over 10, even in the presence of very high strain gradients near a crack tip. The method is then applied to verify a theoretical prediction that the deformation field in a cracked sample under relaxation loading, i.e. constant applied boundary displacement, is stationary in time even as the stress relaxes by a factor of three. 
    more » « less
  5. null (Ed.)
    Over the last few decades, Gyro-Free Inertial Measurement Units (GF-IMUs) have been extensively researched to overcome the limitations of gyroscopes. This research presents a Non-coplanar Accelerometer Array (NAA) for estimating angular velocity with non-specific geometric arrangement of four or more triaxial accelerometers with non-coplanarity constraint. The presented proof of non-coplanar spacial arrangement also provides insights into propagation of the sensor noise and construction of the noise covariance matrices. The system noise depends on the singular values of the relative displacement matrix (between the sensors). A dynamical system model with uncorrelated process and measurement noise is proposed where the accelerometer readings are used simultaneously as process and measurement inputs. The angular velocity is estimated using an Extended Kalman Filter (EKF) that discretizes and linearizes the continuous-discrete time dynamical system. The simulations are performed on a Cube-NAA (Cu-NAA) comprising four accelerometers placed at different vertices of a cube.They analyze the estimation error for static and dynamic movement as the distance between the accelerometers (four accelerometers in cube-orientation) is varied. Here, the system noise is observed to decrease inversely with the length of the cube edge as the arrangement is kept identical. Consequently, the simulation results indicate asymptotic decrease in the standard error of estimation with edge length. The experiments are conducted on a Cu-NAA with five reflective optical markers. The reflective markers are visually tracked using Vicon® to construct the ground truth angular velocity. This unique experimental setup, apart from providing three degrees of rotational freedom of movement, also allows for three degrees of spacial translation (linear acceleration of the Cu-NAA in space). The simulation and experimental results indicate better performance of the proposed EKF as compared to one with correlated process and measurement noises. 
    more » « less