skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Realtime visual-inertial SLAM integrated with radar data to triangulate targets
This paper presents research concerning the use of visual-inertial Simultaneous Localization And Mapping (SLAM) algorithms to aid in Continuous Wave (CW) radar target mapping. SLAM is an established field in which radar has been used to internally contribute to the localization algorithms. Instead, the application in this case is to use SLAM outputs to localize radar data and construct three-dimensional target maps which can be viewed live in augmented reality. These methods are transferable to other types of radar units and sensors, but this paper presents the research showing how the methods can be applied to calculate depth efficiently with CW radar through triangulation using a Boolean intersection algorithm. Localization of the radar target is achieved through quaternion algebra. Due to the compact nature of the SLAM and CW devices, the radar unit can be operated entirely handheld. Targets are scanned in a free-form manner where there is no need to have a gridded scanning layout. The main advantage to this method is eliminating many hours of usage training and expertise, thereby eliminating ambiguity in the location, size and depth of buried or hidden targets. Additionally, this method grants the user the additional power, penetration and sensitivity of CW radar without the lack of range finding. Applications include pipe and buried structure location, avalanche rescue, structural health monitoring and historical site research.  more » « less
Award ID(s):
1647095
PAR ID:
10395890
Author(s) / Creator(s):
; ; ;
Editor(s):
Dennison, Mark S.; Krum, David M.; Sanders-Reed, John ; Arthur, Jarvis 
Date Published:
Journal Name:
SPIE Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations III
Volume:
12125
Issue:
121250G
Page Range / eLocation ID:
15
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Isaacs, Jason C.; Bishop, Steven S. (Ed.)
    Ultra-wideband (UWB) ground penetrating radar (GPR) is an effective, widely used tool for detection and mapping of buried targets. However, traditional ground penetrating radar systems struggle to resolve and identify congested target configurations and irregularly shaped targets. This is a significant limitation for many municipalities who seek to use GPR to locate and image underground utility pipes. This research investigates the implementation of orbital angular momentum (OAM) control in an UWB GPR, with the goal of addressing these limitations. Control of OAM is a novel technique which leverages an additional degree of freedom offered by spatially structured helical waveforms. This paper examines several free-space and buried target configurations to determine the ability of helical OAM waveforms to improve detectability and distinguishability of buried objects including those with symmetric, asymmetric, and chiral geometries. Microwave OAM can be generated using a uniform circular array (UCA) of antennas with phase delays applied according to azimuth angle. Here, a four-channel network analyzer transceiver is connected to a UCA to enable UWB capability. The characteristic phase delays of OAM waveforms are implemented synthetically via signal processing. The viability demonstrated with the method opens design and analysis degrees of freedom for penetrating radar that may help with discerning challenging targets, such as buried landmines and wires. 
    more » « less
  2. Motivated by applications in unmanned aerial based ground penetrating radar for detecting buried landmines, we consider the problem of imaging small point like scatterers situated in a lossy medium below a random rough surface. Both the random rough surface and the absorption in the lossy medium significantly impede the target detection and imaging process. Using principal component analysis we effectively remove the reflection from the air‐soil interface. We then use a modification of the classical synthetic aperture radar imaging functional to image the targets. This imaging method introduces a user‐defined parameter,δ, which scales the resolution by allowing for target localization with sub wavelength accuracy. Numerical results in two dimensions illustrate the robustness of the approach for imaging multiple targets. However, the depth at which targets are detectable is limited due to the absorption in the lossy medium. 
    more » « less
  3. Dennison, Mark S.; Krum, David M.; Sanders-Reed, John; Arthur, Jarvis (Ed.)
    This paper presents research on the use of penetrating radar combined with 3-D computer vision for real-time augmented reality enabled target sensing. Small scale radar systems face the issue that positioning systems are inaccurate, non-portable or challenged by poor GPS signals. The addition of modern computer vision to current cutting-edge penetrating radar technology expands the common 2-D imaging plane to 6 degrees of freedom. Applying the fact that the radar scan itself is a vector with length equivalent to depth from the transmitting and receiving antennae, these technologies used in conjunction can generate an accurate 3-D model of the internal structure of any material for which radar can penetrate. The same computer vision device that localizes the radar data can also be used as the basis for an augmented reality system. Augmented reality radar technology has applications in threat detection (human through-wall, IED, landmine) as well as civil (wall and door structure, buried item detection). For this project, the goal is to create a data registration pipeline and display the radar scan data visually in a 3-D environment using localization from a computer vision tracking device. Processed radar traces are overlayed in real time to an augmented reality screen where the user can view the radar signal intensity to identify and classify targets. 
    more » « less
  4. Motivated by the use of unmanned aerial vehicles (UAVs) for buried landmine detection, we consider the spectral classification of dispersive point targets below a rough air-soil interface. The target location can be estimated using a previously developed method for ground-penetrating synthetic aperture radar involving principal component analysis for ground bounce removal and Kirchhoff migration. For the classification problem, we use the approximate location determined from this imaging method to recover the spectral characteristics of the target over the system bandwidth. For the dispersive point target we use here, this spectrum corresponds to its radar cross section (RCS). For a more general target, this recovered spectrum is a proxy for the frequency dependence of the RCS averaged over angles spanning the synthetic aperture. The recovered spectrum is noisy and exhibits an overall scaling error due to modeling errors. Nonetheless, by smoothing and normalizing this recovered spectrum, we compare it with a library of precomputed normalized spectra in a simple multiclass classification scheme. Numerical simulations in two dimensions validate this method and show that this spectral estimation method is effective for target classification. 
    more » « less
  5. This paper presents a method for robust optimization for online incremental Simultaneous Localization and Mapping (SLAM). Due to the NP-Hardness of data association in the presence of perceptual aliasing, tractable (approximate) approaches to data association will produce erroneous measurements. We require SLAM back-ends that can converge to accurate solutions in the presence of outlier measurements while meeting online efficiency constraints. Existing robust SLAM methods either remain sensitive to outliers, become increasingly sensitive to initialization, or fail to provide online efficiency. We present the robust incremental Smoothing and Mapping (riSAM) algorithm, a robust back-end optimizer for incremental SLAM based on Graduated Non-Convexity. We demonstrate on benchmarking datasets that our algorithm achieves online efficiency, outperforms existing online approaches, and matches or improves the performance of existing offline methods. 
    more » « less