skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Spectranet: A High Resolution Imaging Radar Deep Neural Network for Autonomous Vehicles
The potentials of automotive radar for autonomous driving have not been fully exploited due to the difficulty of extracting targets' information from the radar signals and the lack of radar datasets. In this paper, a novel signal processing pipeline is proposed to address the max ambiguous velocity reduction issue introduced by staggered time division multiplexing (TDM) scheme of high resolution imaging radar system with a large number of transmit antennas. A dataset of 1,410 synchronized frames (stereo cameras, LiDAR, radar) with three classes, i.e., bus, car, and people, is constructed from field experiments. Next, we implement a vanilla SpectraNet and show its promising performance on moving object detection and classification with a mean average precision (mAP) of 81.9% at an intersection over union (IoU) of 0.5.  more » « less
Award ID(s):
2153386
PAR ID:
10394714
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IEEE 12th Sensor Array and Multichannel Signal Processing Workshop (SAM)
Page Range / eLocation ID:
301 to 305
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Dennison, Mark S.; Krum, David M.; Sanders-Reed, John; Arthur, Jarvis (Ed.)
    This paper presents research on the use of penetrating radar combined with 3-D computer vision for real-time augmented reality enabled target sensing. Small scale radar systems face the issue that positioning systems are inaccurate, non-portable or challenged by poor GPS signals. The addition of modern computer vision to current cutting-edge penetrating radar technology expands the common 2-D imaging plane to 6 degrees of freedom. Applying the fact that the radar scan itself is a vector with length equivalent to depth from the transmitting and receiving antennae, these technologies used in conjunction can generate an accurate 3-D model of the internal structure of any material for which radar can penetrate. The same computer vision device that localizes the radar data can also be used as the basis for an augmented reality system. Augmented reality radar technology has applications in threat detection (human through-wall, IED, landmine) as well as civil (wall and door structure, buried item detection). For this project, the goal is to create a data registration pipeline and display the radar scan data visually in a 3-D environment using localization from a computer vision tracking device. Processed radar traces are overlayed in real time to an augmented reality screen where the user can view the radar signal intensity to identify and classify targets. 
    more » « less
  2. In this study, a polarimetric radar forward model operator was developed for the Weather Research and Forecasting (WRF) model that was based on a scattering algorithm using the T-matrix methodology. Three microphysics schemes—Thompson, Morrison 2-moment, and Milbrandt-Yau 2-moment—were supported in the operator. This radar forward operator used the microphysics, thermodynamic, and wind fields from WRF model forecasts to compute horizontal reflectivity, radial velocity, and polarimetric variables including differential reflectivity (ZDR) and specific differential phase (KDP) for S-band radar. A case study with severe convective storms was used to examine the accuracy of the radar operator. Output from the radar operator was compared to real radar observations from the Weather Surveillance Radar–1988 Doppler (WSR-88D) radar. The results showed that the radar forward operator generated realistic polarimetric signatures. The distribution of polarimetric variables agreed well with the hydrometer properties produced by different microphysics schemes. Similar to the observed polarimetric signatures, radar operator output showed ZDR and KDP columns from low-to-mid troposphere, reflecting the large amount of rain within strong updrafts. The Thompson scheme produced a better simulation for the hail storm with a ZDR hole to indicate the existence of graupel in the low troposphere. 
    more » « less
  3. In this study, a polarimetric radar forward model operator was developed for the Weather Research and Forecasting (WRF) model that was based on a scattering algorithm using the T-matrix methodology. Three microphysics schemes—Thompson, Morrison 2-moment, and Milbrandt-Yau 2-moment—were supported in the operator. This radar forward operator used the microphysics, thermodynamic, and wind fields from WRF model forecasts to compute horizontal reflectivity, radial velocity, and polarimetric variables including differential reflectivity (ZDR) and specific differential phase (KDP) for S-band radar. A case study with severe convective storms was used to examine the accuracy of the radar operator. Output from the radar operator was compared to real radar observations from the Weather Surveillance Radar–1988 Doppler (WSR-88D) radar. The results showed that the radar forward operator generated realistic polarimetric signatures. The distribution of polarimetric variables agreed well with the hydrometer properties produced by different microphysics schemes. Similar to the observed polarimetric signatures, radar operator output showed ZDR and KDP columns from low-to-mid troposphere, reflecting the large amount of rain within strong updrafts. The Thompson scheme produced a better simulation for the hail storm with a ZDR hole to indicate the existence of graupel in the low troposphere. 
    more » « less
  4. Abstract There is a need for nowcasting tools to provide timely and accurate updates on the location and rate of spread (ROS) of large wildfires, especially those impacting communities in the wildland urban interface. In this study, we demonstrate how fixed‐site weather radars can be used to fill this gap. Specifically, we develop and test a radar‐based fire‐perimeter tracking tool that leverages the tendency for local maxima in the radar reflectivity to be collocated with active fire perimeters. Reflectivity maxima are located using search radials from points inside a fire polygon, and perimeters are updated at intervals of ∼10 min. The algorithm is tested using publicly available Next Generation Weather Radar radar data for two large and destructive wildfires, the Camp and Bear Fires, both occurring in northern California, USA. The radar‐based fire perimeters are compared with available, albeit limited, satellite and airborne infrared observations, showing good agreement with conventional fire‐tracking tools. The radar data also provide insights into fire ROS, revealing the importance of long‐range spotting in generating ROS that exceeds conventional estimates. One limitation of this study is that high‐resolution fire perimeter validation data are sparsely available, precluding detailed error quantification for the radar estimates drawn from samples spanning a range of environmental conditions and radar configurations. Nevertheless, the radar tracking approach provides the basis for improved situational awareness during high‐impact fires. 
    more » « less
  5. Abstract A THz radar, with its wide bandwidth, is capable of high‐resolution imaging down to the centimeter scale. In this study, a THz radar is applied to detect hydrometeors generated in a spray chamber. The observed backscattering signals show fluctuations at centimeter scales, indicating various hydrometeor distribution patterns along the radar beam. A co‐located High‐Speed Imaging (HSI) sensor is used to measure the Drop Size Distributions (DSD) in the spray chamber. The radar sampling beam is well aligned with the HSI probes, allowing an objective comparison between the remote sensing and in situ observations. In this study, the observed radar power is compared with the power estimated from the HSI measurements. Results show great consistency, with power difference smaller than 0.5 dB. This study demonstrates the feasibility and great potential of using a THz radar for ultra‐high‐resolution observations of clouds in a laboratory facility, and in the real atmosphere. 
    more » « less