skip to main content

Explore Research Products in the NSF-PAR

Title: Leveraging mmWave Imaging and Communications for Simultaneous Localization and Mapping
In this work, we propose a novel approach for high accuracy user localization by merging tools from both millimeter wave (mmWave) imaging and communications. The key idea of the proposed solution is to leverage mmWave imaging to construct a high-resolution 3D image of the line-of-sight (LOS) and non-line-of-sight (NLOS) objects in the environment at one antenna array. Then, uplink pilot signaling with the user is used to estimate the angle-of-arrival and time-of- arrival of the dominant channel paths. By projecting the AoA and ToA information on the 3D mmWave images of the environment, the proposed solution can locate the user with a sub-centimeter accuracy. This approach has several gains. First, it allows accurate simultaneous localization and mapping (SLAM) from a single standpoint, i.e., using only one antenna array. Second, it does not require any prior knowledge of the surrounding environment. Third, it can locate NLOS users, even if their signals experience more than one reflection and without requiring an antenna array at the user. The approach is evaluated using a hardware setup and its ability to provide sub-centimeter localization accuracy is shown  more » « less
Award ID(s):
1847138
NSF-PAR ID:
10135901
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Page Range / eLocation ID:
4539 to 4543
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , Proc. 2020 IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications (SPAWC))
    null (Ed.)
    Localization is one of the most interesting topics related to the promising millimeter wave (mmWave) technology. In this paper, we investigate joint channel estimation and localization for a cooperative mmWave system with several receivers. Due to the strong line-of-sight path common to mmWave channels, one can localize the position of the user by exploiting the signal's angle-of-arrival (AoA). Leveraging a variational Bayesian approach, we obtain soft information about the AoA for each receiver. We then use the soft AoA information and geometrical constraints to localize the position of the user and further improve the channel estimation performance. Numerical results show that the proposed algorithm has centimeter-level localization accuracy for an outdoor scene. In addition, the proposed algorithm provides 1-3 dB of gain for channel estimation by exploiting the correlation among the receiver channels depending on the availability of prior information about the path loss model. 
    more » « less
  2. ; ; ; ( , 2019 IEEE Global Communications Conference)
    null (Ed.)
    Accurate precise positioning at millimeter wave frequencies is possible due to the large available bandwidth that permits precise on-the-fly time of flight measurements using conventional air interface standards. In addition, narrow antenna beamwidths may be used to determine the angles of arrival and departure of the multipath components between the base station and mobile users. By combining accurate temporal and angular information of multipath components with a 3- D map of the environment (that may be built by each user or downloaded a-priori), robust localization is possible, even in non-line-of-sight environments. In this work, we develop an accurate 3-D ray tracer for an indoor office environment and demonstrate how the fusion of angle of departure and time of flight information in concert with a 3-D map of a typical large office environment provides a mean accuracy of 12.6 cm in line-of-sight and 16.3 cm in non-line-of-sight, over 100 receiver distances ranging from 1.5 m to 24.5 m using a single base station. We show how increasing the number of base stations improves the average non-line-of-sight position location accuracy to 5.5 cm at 21 locations with a maximum propagation distance of 24.5 m. Index Terms—localization; positioning; position location; navigation; mmWave; 5G; ray tracing; site-specific propagation; map-based 
    more » « less
  3. ( , In Proc. of NSDI)
    null (Ed.)
    The ability for a smart speaker to localize a user based on his/her voice opens the door to many new applications. In this paper, we present a novel system, MAVL, to localize human voice. It consists of three major components: (i) We first develop a novel multi-resolution analysis to estimate the Angle-of-Arrival (AoA) of time-varying low-frequency coherent voice signals coming from multiple propagation paths; (ii) We then automatically estimate the room structure by emitting acoustic signals and developing an improved 3D MUSIC algorithm; (iii) We finally re-trace the paths using the estimated AoA and room structure to localize the voice. We implement a prototype system using a single speaker and a uniform circular microphone array. Our results show that it achieves median errors of 1.49o and 3.33o for the top two AoAs estimation and achieves median localization errors of 0.31m in line-of-sight (LoS) cases and 0.47m in non-line-of-sight (NLoS) cases. 
    more » « less
  4. ( , 2020 IEEE Global Communciations conference)
    null (Ed.)
    3GPP air interface standards support meter-level position location of a user in a cellular network. With wider bandwidths and narrow antenna beamwidths available at mmWave frequencies, cellular networks now have the potential to provide sub-meter position location for each user. In this work, we provide an overview of 3GPP position location techniques that are designed for line-of-sight propagation. We discuss additional measurements required in the 3GPP standard that enable multipath-based non-line-of-sight position location. Further, we validate the concepts in this paper by using field data to test a map-based position location algorithm in an indoor office environment which has dimensions of 35 m by 65.5 m. We demonstrate how the fusion of angle of arrival and time of flight information in concert with a 3-D map of the office provides a mean accuracy of 5.72 cm at 28 GHz and 6.29 cm at 140 GHz, over 23 receiver distances ranging from 4.2 m to 32.3 m, using a single base station in line-of-sight and non-line-of-sight. We also conduct a theoretical analysis of the typical error experienced in the map-based position location algorithm and show that the complexity of the map-based algorithm is low enough to allow real-time implementation. 
    more » « less
  5. ; ; ; ; ; ; ; ( , Nature Communications)
    Abstract

    Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we introduce a multipixel time-of-flight non-line-of-sight imaging method combining specifically designed Single Photon Avalanche Diode (SPAD) array detectors with a fast reconstruction algorithm that captures and reconstructs live low-latency videos of non-line-of-sight scenes with natural non-retroreflective objects. We develop a model of the signal-to-noise-ratio of non-line-of-sight imaging and use it to devise a method that reconstructs the scene such that signal-to-noise-ratio, motion blur, angular resolution, and depth resolution are all independent of scene depth suggesting that reconstruction of very large scenes may be possible.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email