skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Sensor Package Deployment and Recovery Cone With Integrated Video Streaming for Rapid Structural Health Monitoring
Abstract This study presents an approach for structural health monitoring (SHM) of remote and hazardous structures using unpiloted aerial vehicles (UAVs). The method focuses on overcoming the challenges associated with traditional sensor deployment techniques, which are often costly and risky due to the decaying nature of the targeted structures. Utilizing a multi-rotor UAV platform, a streaming camera is integrated into a recovery cone to aid in visual alignment during deployment and retrieval providing a safe and cost-effective means of sensor delivery. The paper covers the design of a video-broadcasting deployment system with integrated electropermanent magnets (EPMs), housed in a 3D-printed recovery cone, supplemented by redundancy measures to enhance safety and reliability. This proposed system significantly improves the user’s spatial awareness and aids in precise sensor package alignment, facilitated by multiple camera views providing a dual purpose of conducting visual inspection in addition to aiding in sensor delivery. The experimental analysis presented in this study validates the system’s effectiveness, demonstrating the utility of camera-aided sensor delivery for rapid SHM applications. Navigation challenges due to proximity to metal structures and the difficulties associated with signal strength and reflections are also reported. The contribution of this work is a methodology for aerial sensor deployment and retrieval using a lightweight 3D-printed recovery cone with integrated cameras for navigation and sensor alignment.  more » « less
Award ID(s):
2344357 2152896
PAR ID:
10583628
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
American Society of Mechanical Engineers
Date Published:
ISBN:
978-0-7918-8832-2
Format(s):
Medium: X
Location:
Atlanta, Georgia, USA
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper presents a systematic approach on realtime reconstruction of an underwater environment using Sonar, Visual, Inertial, and Depth data. In particular, low lighting conditions, or even complete absence of natural light inside caves, results in strong lighting variations, e.g., the cone of the artificial video light intersecting underwater structures, and the shadow contours. The proposed method utilizes the well defined edges between well lit areas and darkness to provide additional features, resulting into a denser 3D point cloud than the usual point clouds from a Visual SLAM system. Experimental results in an underwater cave at Ginnie Springs, FL, with a custommade underwater sensor suite demonstrate the performance of our system. This will enable more robust navigation of AUVs using the denser 3D point cloud to detect obstacles and achieve higher resolution reconstructions. 
    more » « less
  2. The Internet of Things (IoT) has significantly advanced the application of Wireless Sensor Networks (WSNs) in Structural Health Monitoring (SHM), particularly for civil engineering infrastructure. While unmanned aerial vehicles (UAVs) are commonly employed for data collection, this paper proposes a novel approach using Bluetooth Low Energy (BLE) for synchronization and data gathering in SHM systems. Unlike traditional methods that may suffer from compromised network security and increased energy demands, the BLE-based system ensures that individual sensor nodes operate autonomously, providing inherent security benefits and improved battery longevity. Each sensor node acts independently, minimizing the risk to the overall network if a single node is compromised. We present a synchronization scheme that leverages BLE's low-power consumption to enhance the SHM of bridges, supported by a prototype developed using a PASCO bridge kit with wireless load cells and accelerometers. The proposed BLE protocol, to the best of the authors' knowledge, represents an unexplored avenue in SHM, promising increased safety and efficiency in sensor networks. 
    more » « less
  3. Abstract Ultrasonics structural health monitoring (SHM) is widely recognized as an effective technique that enables early damage detection in large-scale structures and helps prevent potential catastrophic failures. Ultrasonic phased array technology has gained prominence in SHM due to its ability to inspect a large area with high spatial resolution. However, conventional systems often rely on physical wired sensor networks, limiting their deployment for hard-to-access regions. In this study, we present a wireless ultrasonic phased array system capable of dual-mode operation for both wall thickness measurement and structural damage detection. The system integrates wireless power transfer (WPT) modules and customized matching circuits, enabling efficient and flexible deployment. Proof-of-concept experiments demonstrate successful wall thickness evaluation and accurate defect localization in metallic structures using both delay-and-sum (DAS) and minimum variance (MV) imaging methods, with the MV algorithm offering improved imaging resolution. Future work will focus on advancing real-time monitoring through machine learning, enabling 3D imaging, and extending system applicability to anisotropic composite materials. 
    more » « less
  4. null (Ed.)
    Dynamic 3D reconstruction of surgical cavities is essential in a wide range of computer-assisted surgical intervention applications, including but not limited to surgical guidance, pre-operative image registration and vision-based force estimation. According to a survey on vision based 3D reconstruction for abdominal minimally invasive surgery (MIS) [1], real-time 3D reconstruction and tissue deformation recovery remain open challenges to researchers. The main challenges include specular reflections from the wet tissue surface and the highly dynamic nature of abdominal surgical scenes. This work aims to overcome these obstacles by using multiple viewpoint and independently moving RGB cameras to generate an accurate measurement of tissue deformation at the volume of interest (VOI), and proposes a novel efficient camera pairing algorithm. Experimental results validate the proposed camera grouping and pair sequencing, and were evaluated with the Raven-II [2] surgical robot system for tool navigation, the Medtronic Stealth Station s7 surgical navigation system for real- time camera pose monitoring, and the Space Spider white light scanner to derive the ground truth 3D model. 
    more » « less
  5. null (Ed.)
    The Georgia Tech Miniature Autonomous Blimp (GT-MAB) needs localization algorithms to navigate to way-points in an indoor environment without leveraging an external motion capture system. Indoor aerial robots often require a motion capture system for localization or employ simultaneous localization and mapping (SLAM) algorithms for navigation. The proposed strategy for GT-MAB localization can be accomplished using lightweight sensors on a weight-constrained platform like the GT-MAB. We train an end-to-end convolutional neural network (CNN) that predicts the horizontal position and heading of the GT-MAB using video collected by an onboard monocular RGB camera. On the other hand, the height of the GT-MAB is estimated from measurements through a time-of-flight (ToF) single-beam laser sensor. The monocular camera and the single-beam laser sensor are sufficient for the localization algorithm to localize the GT-MAB in real time, achieving the averaged 3D positioning errors to be less than 20 cm, and the averaged heading errors to be less than 3 degrees. With the accuracy of our proposed localization method, we are able to use simple proportional-integral-derivative controllers to control the GT-MAB for waypoint navigation. Experimental results on the waypoint following are provided, which demonstrates the use of a CNN as the primary localization method for estimating the pose of an indoor robot that successfully enables navigation to specified waypoints. 
    more » « less