skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: If structure can exclaim: a novel robotic-assisted percussion method for spatial bolt-ball joint looseness detection
In proportion to the immense construction of spatial structures is the emergence of catastrophes related to structural damages (e.g. loose connections), thus rendering personal injury and property loss. It is therefore essential to detect spatial bolt looseness. Current methods for detecting spatial bolt looseness mostly focus on contact-type measurement, which may not be practical in some cases. Thus, inspired by the sound-based human diagnostic approach, we develop a novel percussion method using the Mel-frequency cepstral coefficient and the memory-augmented neural network in this article. In comparison with current investigations, the main contribution of this article is the detection of multi-bolt looseness for the first time with higher accuracy than prior methods. In particular, in terms of new data obtained via similar joints, the memory-augmented neural network can help avoid inefficient relearn and assimilate new data to provide accurate prediction with only a few data samples, which effectively improves the robustness of detection. Furthermore, percussion was implemented with a robotic arm instead of manual operation, which preliminarily explores the potential of implementing automation applications in real industries. Finally, experimental results demonstrate the effectiveness of the proposed method, which can guide future development of cyber-physics systems for structural health detection.  more » « less
Award ID(s):
1910973
PAR ID:
10282860
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Structural Health Monitoring
Volume:
20
Issue:
4
ISSN:
1475-9217
Page Range / eLocation ID:
1597 to 1608
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Signal anomaly detection is commonly used to detect rogue or unexpected signals. It has many applications in interference mitigation, wireless security, optimized spectrum allocation, and radio coordination. Our work proposes a new method for anomaly detection on signal detection metadata using generative adversarial network output processed by a long short term memory recurrent neural network. We provide a performance analysis and comparison to baseline methods, and demonstrate that through the usage of metadata for analytics, we can provide robust detection, while also minimizing computation and bandwidth, and generalizing to numerous effects which differs from many prior works that focus on A.D. based signal processing on the raw RF sample data. 
    more » « less
  2. Robust Mask R-CNN (Mask Regional Convolutional Neural Network) methods are proposed and tested for automatic detection of cracks on structures or their components that may be damaged during extreme events, such as earthquakes. We curated a new dataset with 2,021 labeled images for training and validation and aimed to find end-to-end deep neural networks for crack detection in the field. With data augmentation and parameters fine-tuning, Path Aggregation Network (PANet) with spatial attention mechanisms and High- resolution Network (HRNet) are introduced into Mask R-CNNs. The tests on three public datasets with low- or high-resolution images demonstrate that the proposed methods can achieve a big improvement over alternative networks, so the proposed method may be sufficient for crack detection for a variety of scales in real applications. 
    more » « less
  3. Predicting violent storms and dangerous weather conditions with current models can take a long time due to the immense complexity associated with weather simulation. Machine learning has the potential to classify tornadic weather patterns much more rapidly, thus allowing for more timely alerts to the public. To deal with class imbalance challenges in machine learning, different data augmentation approaches have been proposed. In this work, we examine the wall time difference between live data augmentation methods versus the use of preaugmented data when they are used in a convolutional neural network based training for tornado prediction. We also compare CPU and GPU based training over varying sizes of augmented data sets. Additionally we examine what impact varying the number of GPUs used for training will produce given a convolutional neural network. 
    more » « less
  4. Abstract Bayesian inference based on computational simulations plays a crucial role in model-informed damage diagnostics and the design of reliable engineering systems, such as the miter gates studied in this article. While Bayesian inference for damage diagnostics has shown success in some applications, the current method relies on monitoring data from solely the asset of interest and may be affected by imperfections in the computational simulation model. To address these limitations, this article introduces a novel approach called Bayesian inference-based damage diagnostics enhanced through domain translation (BiEDT). The proposed BiEDT framework incorporates historical damage inspection and monitoring data from similar yet different miter gates, aiming to provide alternative data-driven methods for damage diagnostics. The proposed framework first translates observations from different miter gates into a unified analysis domain using two domain translation techniques, namely, cycle-consistent generative adversarial network (CycleGAN) and domain-adversarial neural network (DANN). Following the domain translation, a conditional invertible neural network (cINN) is employed to estimate the damage state, with uncertainty quantified in a Bayesian manner. Additionally, a Bayesian model averaging and selection method is developed to integrate the posterior distributions from different methods and select the best model for decision-making. A practical miter gate structural system is employed to demonstrate the efficacy of the BiEDT framework. Results indicate that the alternative damage diagnostics approaches based on domain translation can effectively enhance the performance of Bayesian inference-based damage diagnostics using computational simulations. 
    more » « less
  5. Two-photon calcium imaging provides large-scale recordings of neuronal activities at cellular resolution. A robust, automated and high-speed pipeline to simultaneously segment the spatial footprints of neurons and extract their temporal activity traces while decontaminating them from background, noise and overlapping neurons is highly desirable to analyse calcium imaging data. Here we demonstrate DeepCaImX, an end-to-end deep learning method based on an iterative shrinkage-thresholding algorithm and a long short-term memory neural network to achieve the above goals altogether at a very high speed and without any manually tuned hyperparameter. DeepCaImX is a multi-task, multi-class and multi-label segmentation method composed of a compressed sensing-inspired neural network with a recurrent layer and fully connected layers. The neural network can simultaneously generate accurate neuronal footprints and extract clean neuronal activity traces from calcium imaging data. We trained the neural network with simulated datasets and benchmarked it against existing state-of-the-art methods with in vivo experimental data. DeepCaImX outperforms existing methods in the quality of segmentation and temporal trace extraction as well as processing speed. DeepCaImX is highly scalable and will benefit the analysis of mesoscale calcium imaging. 
    more » « less