skip to main content


Title: Spectranet: A High Resolution Imaging Radar Deep Neural Network for Autonomous Vehicles
The potentials of automotive radar for autonomous driving have not been fully exploited due to the difficulty of extracting targets' information from the radar signals and the lack of radar datasets. In this paper, a novel signal processing pipeline is proposed to address the max ambiguous velocity reduction issue introduced by staggered time division multiplexing (TDM) scheme of high resolution imaging radar system with a large number of transmit antennas. A dataset of 1,410 synchronized frames (stereo cameras, LiDAR, radar) with three classes, i.e., bus, car, and people, is constructed from field experiments. Next, we implement a vanilla SpectraNet and show its promising performance on moving object detection and classification with a mean average precision (mAP) of 81.9% at an intersection over union (IoU) of 0.5.  more » « less
Award ID(s):
2153386
PAR ID:
10394714
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IEEE 12th Sensor Array and Multichannel Signal Processing Workshop (SAM)
Page Range / eLocation ID:
301 to 305
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. A THz radar, with its wide bandwidth, is capable of high‐resolution imaging down to the centimeter scale. In this study, a THz radar is applied to detect hydrometeors generated in a spray chamber. The observed backscattering signals show fluctuations at centimeter scales, indicating various hydrometeor distribution patterns along the radar beam. A co‐located High‐Speed Imaging (HSI) sensor is used to measure the Drop Size Distributions (DSD) in the spray chamber. The radar sampling beam is well aligned with the HSI probes, allowing an objective comparison between the remote sensing and in situ observations. In this study, the observed radar power is compared with the power estimated from the HSI measurements. Results show great consistency, with power difference smaller than 0.5 dB. This study demonstrates the feasibility and great potential of using a THz radar for ultra‐high‐resolution observations of clouds in a laboratory facility, and in the real atmosphere. 
    more » « less
  2. Dennison, Mark S. ; Krum, David M. ; Sanders-Reed, John ; Arthur, Jarvis (Ed.)
    This paper presents research on the use of penetrating radar combined with 3-D computer vision for real-time augmented reality enabled target sensing. Small scale radar systems face the issue that positioning systems are inaccurate, non-portable or challenged by poor GPS signals. The addition of modern computer vision to current cutting-edge penetrating radar technology expands the common 2-D imaging plane to 6 degrees of freedom. Applying the fact that the radar scan itself is a vector with length equivalent to depth from the transmitting and receiving antennae, these technologies used in conjunction can generate an accurate 3-D model of the internal structure of any material for which radar can penetrate. The same computer vision device that localizes the radar data can also be used as the basis for an augmented reality system. Augmented reality radar technology has applications in threat detection (human through-wall, IED, landmine) as well as civil (wall and door structure, buried item detection). For this project, the goal is to create a data registration pipeline and display the radar scan data visually in a 3-D environment using localization from a computer vision tracking device. Processed radar traces are overlayed in real time to an augmented reality screen where the user can view the radar signal intensity to identify and classify targets. 
    more » « less
  3. In this study, a polarimetric radar forward model operator was developed for the Weather Research and Forecasting (WRF) model that was based on a scattering algorithm using the T-matrix methodology. Three microphysics schemes—Thompson, Morrison 2-moment, and Milbrandt-Yau 2-moment—were supported in the operator. This radar forward operator used the microphysics, thermodynamic, and wind fields from WRF model forecasts to compute horizontal reflectivity, radial velocity, and polarimetric variables including differential reflectivity (ZDR) and specific differential phase (KDP) for S-band radar. A case study with severe convective storms was used to examine the accuracy of the radar operator. Output from the radar operator was compared to real radar observations from the Weather Surveillance Radar–1988 Doppler (WSR-88D) radar. The results showed that the radar forward operator generated realistic polarimetric signatures. The distribution of polarimetric variables agreed well with the hydrometer properties produced by different microphysics schemes. Similar to the observed polarimetric signatures, radar operator output showed ZDR and KDP columns from low-to-mid troposphere, reflecting the large amount of rain within strong updrafts. The Thompson scheme produced a better simulation for the hail storm with a ZDR hole to indicate the existence of graupel in the low troposphere. 
    more » « less
  4. In this study, a polarimetric radar forward model operator was developed for the Weather Research and Forecasting (WRF) model that was based on a scattering algorithm using the T-matrix methodology. Three microphysics schemes—Thompson, Morrison 2-moment, and Milbrandt-Yau 2-moment—were supported in the operator. This radar forward operator used the microphysics, thermodynamic, and wind fields from WRF model forecasts to compute horizontal reflectivity, radial velocity, and polarimetric variables including differential reflectivity (ZDR) and specific differential phase (KDP) for S-band radar. A case study with severe convective storms was used to examine the accuracy of the radar operator. Output from the radar operator was compared to real radar observations from the Weather Surveillance Radar–1988 Doppler (WSR-88D) radar. The results showed that the radar forward operator generated realistic polarimetric signatures. The distribution of polarimetric variables agreed well with the hydrometer properties produced by different microphysics schemes. Similar to the observed polarimetric signatures, radar operator output showed ZDR and KDP columns from low-to-mid troposphere, reflecting the large amount of rain within strong updrafts. The Thompson scheme produced a better simulation for the hail storm with a ZDR hole to indicate the existence of graupel in the low troposphere. 
    more » « less
  5. null (Ed.)
    Effective radar cross-section (ERCS) for microwave Doppler radar, is defined by the reflected power from sections of the human body that undergo physiological motion. This paper investigates ERCS for human cardiopulmonary motion of sedentary subjects at three different positions (front, back and side with respect to radar). While human breathing and heartbeat can be measured from all four sides of the body, the characteristics of measured signals will vary with body orientation. Thus, continuous wave radar with quadrature architecture at 2. 4GHz was used to test a sedentary subject for three minutes from three different orientations: front, back and side with respect to radar. The results obtained from the tests showed that physiological motion could be obtained and that distinct patterns emerge due to the differences in the ERCS for each orientation. For the seated subject, back ERCS was higher than for front and side positions. Determining ERCS changes with position may enable determining body orientation with respect to the radar. This research opens further opportunities for development of high-resolution occupancy sensing and emergency search and rescue sensing, where the orientation of a human subject may be unknown ahead of time. 
    more » « less