skip to main content


Title: Multi-sensor data collection and fusion using autoencoders in condition evaluation of concrete bridge decks
Abstract This paper presents a multi-sensor data collection and data fusion procedure for nondestructive evaluation/testing (NDE/NDT) of a concrete bridge deck. Three NDE technologies, vertical electrical impedance (VEI), ground-penetrating radar (GPR), and high-definition imaging (HDI) for surface crack detection, were deployed on the bridge deck. A neural network autoencoder was trained to quantify the relationship between VEI and GPR results using the data collected at common positions. This relationship was then used for fusion of VEI and GPR data to increase the reliability and spatial resolution of the NDE measurements and to generate a data-fused condition map that showed novel characteristics. Threshold values for VEI and GPR tests were obtained and used to determine the color scale in the fused map. Surface cracks identified from HDI show reasonable agreement with the deterioration areas on the data-fused condition map. Chloride concentration measurements on sound and deteriorated areas of the deck were consistent with the NDE results.  more » « less
Award ID(s):
1762034
NSF-PAR ID:
10278216
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Journal of Infrastructure Preservation and Resilience
Volume:
2
Issue:
1
ISSN:
2662-2521
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    This paper investigates an ultrasound (US) imaging-based methodology to assess the contraction levels of plantar flexors quantitatively. Echogenicity derived from US imaging at different anatomical depths, including both lateral gastrocnemius (LGS) and soleus (SOL) muscles, is used for the prediction of the volitional isometric plantar flexion moment. Synchronous measurements, including a plantar flexion torque signal, a surface electromyography (sEMG) signal, and US imaging of both LGS and SOL muscles, are collected. Four feature sets, including sole sEMG, sole LGS echogenicity, sole SOL echogenicity, and their fusion, are used to train a Gaussian process regression (GPR) model and predict plantar flexion torque. The experimental results on four non-disabled participants show that the torque prediction accuracy is improved significantly by using the LGS or SOL echogenicity signal than using the sEMG signal. However, there is no significant improvement by using the fused feature compared to sole LGS or SOL echogenicity. The findings imply that using US imaging-derived signals improves the accuracy of predicting volitional effort on human plantar flexors. Potentially, US imaging can be used as a new sensing modality to measure or predict human lower limb motion intent in clinical rehabilitation devices. 
    more » « less
  2. The Federal Highway Administration (FHWA) mandates biannual bridge inspections to assess the condition of all bridges in the United States. These inspections are recorded in the National Bridge Inventory (NBI) and the respective state’s databases to manage, study, and analyze the data. As FHWA specifications become more complex, inspections require more training and field time. Recently, element-level inspections were added, assigning a condition state to each minor element in the bridge. To address this new requirement, a machine-aided bridge inspection method was developed using artificial intelligence (AI) to assist inspectors. The proposed method focuses on the condition state assessment of cracking in reinforced concrete bridge deck elements. The deep learning-based workflow integrated with image classification and semantic segmentation methods is utilized to extract information from images and evaluate the condition state of cracks according to FHWA specifications. The new workflow uses a deep neural network to extract information required by the bridge inspection manual, enabling the determination of the condition state of cracks in the deck. The results of experimentation demonstrate the effectiveness of this workflow for this application. The method also balances the costs and risks associated with increasing levels of AI involvement, enabling inspectors to better manage their resources. This AI-based method can be implemented by asset owners, such as Departments of Transportation, to better serve communities. 
    more » « less
  3. Ground penetrating radar (GPR) is a remote geophysical sensing method that has been applied in the localization of underground utilities, bridge deck survey, localization of landmines, mapping of terrain for aid in driverless cars, etc. Multistatic GPR can deliver a faster survey, wider spatial coverage, and multiple viewpoints of the subsurface. However, because of the transmit and receive antennas spatial offset, formation of 3D GPR image by simple stacking of the acquired A-scans is inaccurate. Also, averaging of different receivers data may lead to destructive interference of back-scattered waves due to different time delays implied by the spatial offset, so averaging does not lead to higher SNR in general. Furthermore, the energy back-scattered by scatter points are spread in hyperbolas in the GPR raw data. Migration or imaging algorithms are employed to increase SNR by focusing the hyperbolas. This focusing process also leads to better accuracy in target localization. In this paper, a computationally efficient synthetic aperture radar (SAR) imaging algorithm that properly integrates multistatic GPR data in both ground and air-coupled cases is presented. The algorithm is successfully applied on two synthetic datasets. 
    more » « less
  4. Largely due to superior properties compared to traditional materials, the use of polymer matrix composites (PMC) has been expanding in several industries such as aerospace, transportation, defense, and marine. However, the anisotropy and nonhomogeneity of these structures contribute to the difficulty in evaluating structural integrity; damage sites can occur at multiple locations and length scales and are hard to track over time. This can lead to unpredictable and expensive failure of a safety-critical structure, thus creating a need for non-destructive evaluation (NDE) techniques which can detect and quantify small-scale damage sites and track their progression. Our research group has improved upon classical microwave techniques to address these needs; utilizing a custom device to move a sample within a resonant cavity and create a spatial map of relative permittivity. We capitalize on the inevitable presence of moisture within the polymer network to detect damage. The differing migration inclinations of absorbed water molecules in a pristine versus a damaged composite alters the respective concentrations of the two chemical states of moisture. The greater concentration of free water molecules residing in the damage sites exhibit highly different relative permittivity when compared to the higher ratio of polymer-bound water molecules in the undamaged areas. Currently, the technique has shown the ability to detect impact damage across a range of damage levels and gravimetric moisture contents but is not able to specifically quantify damage extent with regards to impact energy level. The applicability of machine learning (ML) to composite materials is substantial, with uses in areas like manufacturing and design, prediction of structural properties, and damage detection. Using traditional NDE techniques in conjunction with supervised or unsupervised ML has been shown to improve the accuracy, reliability, or efficiency of the existing methods. In this work, we explore the use of a combined unsupervised/supervised ML approach to determine a damage boundary and quantification of single-impact specimens. Dry composite specimens were damaged via drop tower to induce one central impact site of 0, 2, or 3 Joules. After moisture exposure, Entrepreneur Dr, Raleigh, North Carolina 27695, U.S.A. 553 each specimen underwent dielectric mapping, and spatial permittivity maps were created at a variety of gravimetric moisture contents. An unsupervised K-means clustering algorithm was applied to the dielectric data to segment the levels of damage and define a damage boundary. Subsequently, supervised learning was used to quantify damage using features including but not limited to thickness, moisture content, permittivity values of each cluster, and average distance between points in each cluster. A regression model was trained on several samples with impact energy as the predicted variable. Evaluation was then performed based on prediction accuracy for samples in which the impact energies are not known to the model.

     
    more » « less
  5. null (Ed.)
    This work proposes a rigorous and practical algorithm for quad-mesh generation based the Abel-Jacobi theory of algebraic \textcolor{red}{curves}. We prove sufficient and necessary conditions for a flat metric with cone singularities to be compatible with a quad-mesh, in terms of the deck-transformation, then develop an algorithm based on the theorem. The algorithm has two stages: first, a meromorphic quartic differential is generated to induce a T-mesh; second, the edge lengths of the T-mesh are adjusted by solving a linear system to satisfy the deck transformation condition, which produces a quad-mesh. In the first stage, the algorithm pipeline can be summarized as follows: calculate the homology group; compute the holomorphic differential group; construct the period matrix of the surface and Jacobi variety; calculate the Abel-Jacobi map for a given divisor; optimize the divisor to satisfy the Abel-Jacobi condition by integer programming; compute \textcolor{red}{a} flat Riemannian metric with cone singularities at the divisor by Ricci flow; \textcolor{red}{isometrically} immerse the surface punctured at the divisor onto the complex plane and pull back the canonical holomorphic differential to the surface to obtain the meromorphic quartic differential; construct a motorcycle graph to generate a T-Mesh. In the second stage, the deck transformation constraints are formulated as a linear equation system of the edge lengths of the T-mesh. The solution provides a flat metric with integral deck transformations, which leads to the final quad-mesh. The proposed method is rigorous and practical. The T-mesh and quad-mesh results can be applied for constructing Splines directly. The efficiency and efficacy of the proposed algorithm are demonstrated by experimental results on surfaces with complicated topologies and geometries. 
    more » « less