skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 10:00 PM ET on Friday, December 8 until 2:00 AM ET on Saturday, December 9 due to maintenance. We apologize for the inconvenience.

Title: Deep Q-Network for 5G NR Downlink Scheduling
The Third Generation Partnership Project (3GPP) introduced the fifth generation new radio (5G NR) specifications which offer much higher flexibility than legacy cellular communications standards to better handle the heterogeneous service and performance requirements of the emerging use cases. This flexibility, however, makes the resources management more complex. This paper therefore designs a data driven resource allocation method based on the deep Q-network (DQN). The objective of the proposed model is to maximize the 5G NR cell throughput while providing a fair resource allocation across all users. Numerical results using a 3GPP compliant 5G NR simulator demonstrate that the DQN scheduler better balances the cell throughput and user fairness than existing schedulers.  more » « less
Award ID(s):
2030291 2120442
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Deep Q-Network for 5G NR Downlink Scheduling
Page Range / eLocation ID:
312 to 317
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. With the commercialization and deployment of 5G, efforts are beginning to explore the design of the next generation of cellular networks, called 6G. New and constantly evolving use cases continue to place performance demands, especially for low latency communications, as these are still challenges for the 3GPP-specified 5G design, and will have to be met by the 6G design. Therefore, it is helpful to re-examine several aspects of the current cellular network’s design and implementation.Based on our understanding of the 5G cellular network specifications, we explore different implementation options for a dis-aggregated 5G core and their performance implications. To improve the data plane performance, we consider advanced packet classification mechanisms to support fast packet processing in the User Plane Function (UPF), to improve the poor performance and scalability of the current design based on linked lists. Importantly, we implement the UPF function on a SmartNIC for forwarding and tunneling. The SmartNIC provides the fastpath for device traffic, while more complex functions of buffering and processing flows that suffer a miss on the SmartNIC P4 tables are processed by the host-based UPF. Compared to an efficient DPDK-based host UPF, the SmartNIC UPF increases the throughput for 64 Byte packets by almost 2×. Furthermore, we lower the packet forwarding latency by 3.75× by using the SmartNIC. In addition, we propose a novel context-level QoS mechanism that dynamically updates the Packet Detection Rule priority and resource allocation of a flow based on the user context. By combining our innovations, we can achieve low latency and high throughput that will help us evolve to the next generation 6G cellular networks. 
    more » « less
  2. In December 2017, the Third Generation Partnership Project (3GPP) released the first set of specifications for 5G New Radio (NR), which is currently the most widely accepted 5G cellular standard. 5G NR is expected to replace LTE and previous generations of cellular technology over the next several years, providing higher throughput, lower latency, and a host of new features. Similar to LTE, the 5G NR physical layer consists of several physical channels and signals, most of which are vital to the operation of the network. Unfortunately, like for any wireless technology, disruption through radio jamming is possible. This paper investigates the extent to which 5G NR is vulnerable to jamming and spoofing, by analyzing the physical downlink and uplink control channels and signals. We identify the weakest links in the 5G NR frame, and propose mitigation strategies that should be taken into account during implementation of 5G NR chipsets and base stations. 
    more » « less
  3. Fifth-generation (5G) new radio (NR) deployments are being rolled out in both the C–band (3.3 - 5.0 GHz) and millimeter-wave (mmWave) band (24.5 - 29.5 GHz). For outdoor scenarios, the C–band is expected to provide wide area coverage and throughput uniformity, whereas the mmWave band is expected to provide ultra-high throughput to dedicated areas within the C-band coverage. Due to the differences in the frequency bands, both systems are expected to be designed with different transmit and receive parameters, naturally resulting in performance variations proportional to the chosen parameters. Unlike many previous works, this paper presents measurement evaluations in central Auckland, New Zealand, from a precommercial deployment of a single-user, single-cell 5G-NR system operating in both bands. The net throughput, coverage reliability, and channel rank are analyzed across the two bands with baseband and analog beamforming. Our results show that the C-band coverage is considerably better than mmWave, with a consistently higher channel rank. Furthermore, the spatial stationarity region (SSR) for the azimuth angles-of-departure (AODs) is characterized, and a model derived from the measured beam identities is presented. The SSR of azimuth AODs is seen to closely follow a gamma distribution. 
    more » « less
  4. Abstract—Joint communication an dsensing allows the utiliza- tion of common spectral resources for communication and local- ization, reducing the cost of deployment. By using fifth generation (5G) New Radio (NR)(i.e.,the 3rd Generation Partnership Project Radio Access Network for 5G) reference signals,conventionally used for communication,this paper shows sub-meter precision localization is possible at millimeter wave frequencies.We derive the geometric dilution of precision of a bistatic radar configura- tion, a theoretical metric that characterizes how the target location estimation error varies as a function of the bistatic geometry and measurement errors.We develop a 5GNR compliant software test bench to characterize the measurement errors when estimating the time difference of arrival and angle of arrival with5GNR waveforms.The test bench is further utilized to demonstrate the accuracy of target localization and velocity estimation in several indoor and outdoor bistatic and multistatic configurations and to show that on average,the bistatic cconfiguration can achieve a location accuracy of 10.0 cm over a bistatic range of 25m, which can be further improved by deploying a multistaticradar configuration. Index Terms—5G NR;Bistatic Radar;Multistatic Radar;ge- ometric dilution of precision (GDOP);3GPP;localization;posi- tioning; position location 
    more » « less
  5. null (Ed.)
    The ubiquitous of 5G New Radio (5G NR) accelerates the massive implementations in many fields including swarm Unmanned Aircraft System (UAS) networking. The ultra capacities of 5G NR can provide more sufficient networking services for the swarm UAS networking which can enable swarm UAS to deploy in more complex and challenging scenarios to achieve missions. However, the conventional swarm UAS networking are mainly centralized or hierarchical which is vulnerable to the dynamics and the deployment of swarm UAS networking on a large scale. In this paper, we formulate a cell wall communications for the heterogeneous swarm UAS networking with the inspiration of biological cell wall communication. Fueled by reinforcement learning, we resolve the edge-coloring problem of cell wall communication scheduling to achieve the maximum throughput between the heterogeneous swarm UAS networking globally. The evaluation shows our proposed reinforcement learning enabled algorithm can surpass the conventional scheduling algorithms over 90% when the time piece is less than 0.01s and achieve the optimal throughput for the heterogeneous swarm UAS networking. 
    more » « less