skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Second-Best Beam-Alignment via Bayesian Multi-Armed Bandits
Millimeter-wave (mm-wave) systems rely on narrow- beams to cope with the severe signal attenuation in the mm- wave frequency band. However, susceptibility to beam mis- alignment due to mobility or blockage requires the use of beam- alignment schemes, with huge cost in terms of overhead and use of system resources. In this paper, a beam-alignment scheme is proposed based on Bayesian multi-armed bandits, with the goal to maximize the alignment probability and the data-communication throughput. A Bayesian approach is proposed, by considering the state as a posterior distribution over angles of arrival (AoA) and of departure (AoD), given the history of feedback signaling and of beam pairs scanned by the base-station (BS) and the user- end (UE). A simplified sufficient statistic for optimal control is identified, in the form of preference of BS-UE beam pairs. By bounding a value function, the second-best preference policy is formulated, which strikes an optimal balance between exploration and exploitation by selecting the beam pair with the current second-best preference. Through Monte-Carlo simulation with analog beamforming, the superior performance of the second- best preference policy is demonstrated in comparison to existing schemes based on first-best preference, linear Thompson sampling, and upper confidence bounds, with up to 7%, 10% and 30% improvements in alignment probability, respectively.  more » « less
Award ID(s):
1642982
PAR ID:
10195594
Author(s) / Creator(s):
;
Date Published:
Journal Name:
IEEE Global Communications Conference (GLOBECOM)
Page Range / eLocation ID:
1 to 6
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper studies the effects of millimeter-wave (mm-wave) beam alignment errors on the downlink achievable rate of a heterogeneous network (HetNet), which consists of sub-6 GHz macro-cells and mm-wave small-cells. The alignment error is modeled as a function of the underlying mm-wave link parameters. The conventional maximum biased received power criterion, where the bias is used for mm-wave small-cells, is adopted for cell associations. By varying the value of the bias factor, we investigate the changes in the downlink rate coverage probability. Our simulation results indicate that high values (of the order of 30 dB) for the bias, while beneficial in the case of perfect alignment, are actually disadvantageous for the low-rate users in the case of imperfect beam alignment. The low-rate users are better served by a moderate value (of the order of 20 dB) of the bias when the beam alignment errors are accounted for. We also show that the above disparity can be narrowed down by increasing by mm-wave base station (BS) antennas and/or the mm-wave BS density. 
    more » « less
  2. Beam alignment is a critical aspect in millimeter wave (mm-wave) cellular systems. However, the inherent limitations of channel estimation result in beam alignment errors, which degrade the system performance. For systems with a large number of antennas at the base station, downlink channel estimation is performed using uplink pilot signals. The beam alignment errors, thus, depend on the user equipment (UE) transmit power, which needs to be managed properly as the UEs are battery powered. This paper investigates how the use of uplink power control for the transmission of pilot signals in a mm-wave network affects the downlink beam alignment errors, which depend on various link parameters. We use stochastic geometry and statistics of the Student's t -distribution to develop an analytical model, which captures the interplay between the uplink power control and downlink signal-to-noise ratio (SNR) coverage probability. Our results indicate that using uplink power control significantly reduces UE power consumption without adversely affecting the downlink SNR coverage. 
    more » « less
  3. We propose a novel analytical framework for evaluating the coverage performance of a millimeter wave (mmWave) cellular network where idle user equipments (UEs) act as relays. In this network, the base station (BS) adopts either the direct mode to transmit to the destination UE, or the relay mode if the direct mode fails, where the BS transmits to the relay UE and then the relay UE transmits to the destination UE. To address the drastic rotational movements of destination UEs in practice, we propose to adopt selection combining at destination UEs. New expression is derived for the signal-to-interference-plus-noise ratio (SINR) coverage probability of the network. Using numerical results, we first demonstrate the accuracy of our new expression. Then we show that ignoring spatial correlation, which has been commonly adopted in the literature, leads to severe over estimation of the SINR coverage probability. Furthermore, we show that introducing relays into a mmWave cellular network vastly improves the coverage performance. In addition, we show that the optimal BS density maximizing the SINR coverage probability can be determined by using our analysis. 
    more » « less
  4. To overcome the high pathloss and the intense shadowing in millimeterwave (mmWave) communications, effective beamforming schemes are required which incorporate narrow beams with high beamforming gains. The mm Wave channel consists of a few spatial clusters each associated with an angle of departure (AoD). The narrow beams must be aligned with the channel AoDs to increase the beamforming gain. This is achieved through a procedure called beam alignment (BA). Most of the BA schemes in the literature consider channels with a single dominant path while in practice the channel has a few resolvable paths with different AoDs, hence, such BA schemes may not work correctly in the presence of multi-path or at the least do not exploit such multi path to achieve diversity or increase robustness. In this paper, we propose an efficient BA schemes in presence of multi-path. The proposed BA scheme transmits probing packets using a set of scanning beams and receives the feedback for all the scanning beams at the end of probing phase from each user. We formulate the BA scheme as minimizing the expected value of the average transmission beamwidth under different policies. The policy is defined as a function from the set of received feedback to the set of transmission beams (TB). In order to maximize the number of possible feedback sequences, we prove that the set of scanning beams (SB) has an special form, namely, Tulip Design. Consequently, we rewrite the minimization problem with a set of linear constraints and reduced number of variables which is solved by using an efficient greedy algorithm. 
    more » « less
  5. We propose a novel sensing approach for the beam alignment problem in millimeter wave systems using a single Radio Frequency (RF) chain. Conventionally, beam alignment using a single phased array involves comparing beamformer output power across different spatial regions. This incurs large training overhead due to the need to perform the beam scan operation. The proposed Synthesis of Virtual Array Manifold (SVAM) sensing methodology is inspired from synthetic aperture radar systems and realizes a virtual array geometry over temporal measurements. We demonstrate the benefits of SVAM using Cramer-Rao bound (CRB) analysis over schemes that repeat beam pattern to boost signal-to-noise (SNR) ratio. We also showcase versatile applicability of the proposed SVAM sensing by incorporating it within existing beam alignment procedures that assume perfect knowledge of the small-scale fading coefficient. We further consider the practical scenario wherein we estimate the fading coefficient and propose a novel beam alignment procedure based on efficient computation of an approximate posterior density on dominant path angle. We provide numerical experiments to study the impact of parameters involved in the procedure. The performance of the proposed sensing and beam alignment algorithm is empirically observed to approach the fading coefficient-perfectly known performance, even at low SNR. 
    more » « less