skip to main content

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Distributed Cooperative Spectrum Sharing in UAV Networks Using Multi-Agent Reinforcement Learning
In this paper, we develop a distributed mechanism for spectrum sharing among a network of unmanned aerial vehicles (UAV) and licensed terrestrial networks. This method can provide a practical solution for situations where the UAV network may need external spectrum when dealing with congested spectrum or need to change its operational frequency due to security threats. Here we study a scenario where the UAV network performs a remote sensing mission. In this model, the UAVs are categorized to two clusters of relaying and sensing UAVs. The relay UAVs provide a relaying service for a licensed network to obtain spectrum access for the rest of UAVs that perform the sensing task. We develop a distributed mechanism in which the UAVs locally decide whether they need to participate in relaying or sensing considering the fact that communications among UAVs may not be feasible or reliable. The UAVs learn the optimal task allocation using a distributed reinforcement learning algorithm. Convergence of the algorithm is discussed and simulation results are presented for different scenarios to verify the convergence.  more » « less
Award ID(s):
1755984
PAR ID:
10133283
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
16th IEEE Annual Consumer Communications & Networking Conference (CCNC)
Page Range / eLocation ID:
1 to 6
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , Sensors)
    null (Ed.)
    Modern Public Safety Networks (PSNs) are assisted by Unmanned Aerial Vehicles (UAVs) to provide a resilient communication paradigm during catastrophic events. In this context, we propose a distributed user-centric risk-aware resource management framework in UAV-assisted PSNs supported by both a static UAV and a mobile UAV. The mobile UAV is entitled to a larger portion of the available spectrum due to its capability and flexibility to re-position itself, and therefore establish better communication channel conditions to the users, compared to the static UAV. However, the potential over-exploitation of the mobile UAV-based communication by the users may lead to the mobile UAV’s failure to serve the users due to the increased levels of interference, consequently introducing risk in the user decisions. To capture this uncertainty, we follow the principles of Prospect Theory and design a user’s prospect-theoretic utility function that reflects user’s risk-aware behavior regarding its transmission power investment to the static and/or mobile UAV-based communication option. A non-cooperative game among the users is formulated, where each user determines its power investment strategy to the two available communication choices in order to maximize its expected prospect-theoretic utility. The existence and uniqueness of a Pure Nash Equilibrium (PNE) is proven and the convergence of the users’ strategies to it is shown. An iterative distributed and low-complexity algorithm is introduced to determine the PNE. The performance of the proposed user-centric risk-aware resource management framework in terms of users’ achievable data rate and spectrum utilization, is achieved via modeling and simulation. Furthermore, its superiority and benefits are demonstrated, by comparing its performance against other existing approaches with regards to UAV selection and spectrum utilization. 
    more » « less
  2. ; ; ; ; ; ; ( , 2021 18th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON))
    null (Ed.)
    To mitigate the long-term spectrum crunch problem, the FCC recently opened up the 6 GHz frequency band for unlicensed use. However, the existing spectrum sharing strategies cannot support the operation of access points in moving vehicles such as cars and UAVs. This is primarily because of the directionality-based spectrum sharing among the incumbent systems in this band and the high mobility of the moving vehicles, which together make it challenging to control the cross-system interference. In this paper we propose SwarmShare, a mobility-resilient spectrum sharing framework for swarm UAV networking in the 6 GHz band. We first present a mathematical formulation of the SwarmShare problem, where the objective is to maximize the spectral efficiency of the UAV network by jointly controlling the flight and transmission power of the UAVs and their association with the ground users, under the interference constraints of the incumbent system. We find that there are no closed-form mathematical models that can be used characterize the statistical behaviors of the aggregate interference from the UAVs to the incumbent system. Then we propose a data-driven three-phase spectrum sharing approach, including Initial Power Enforcement, Offline-dataset Guided Online Power Adaptation, and Reinforcement Learning-based UAV Optimization. We validate the effectiveness of SwarmShare through an extensive simulation campaign. Results indicate that, based on SwarmShare, the aggregate interference from the UAVs to the incumbent system can be effectively controlled below the target level without requiring the real-time cross-system channel state information. The mobility resilience of SwarmShare is also validated in coexisting networks with no precise UAV location information. 
    more » « less
  3. ( , Proceedings of the International ISCRAM Conference)
    Robots such as unmanned aerial vehicles (UAVs) deployed for search and rescue (SAR) can explore areas where human searchers cannot easily go and gather information on scales that can transform SAR strategy. Multi-UAV teams therefore have the potential to transform SAR by augmenting the capabilities of human teams and providing information that would otherwise be inaccessible. Our research aims to develop new theory and technologies for field deploying autonomous UAVs and managing multi-UAV teams working in concert with multi-human teams for SAR. Specifically, in this paper we summarize our work in progress towards these goals, including: (1) a multi-UAV search path planner that adapts to human behavior; (2) an in-field distributed computing prototype that supports multi-UAV computation and communication; (3) behavioral modeling that fields spatially localized predictions of lost person location; and (4) an interface between human searchers and UAVs that facilitates human-UAV interaction over a wide range of autonomy. 
    more » « less
  4. ; ; ; ; ; ( , AIAA SciTech Forum, San Diego, CA)
    With the growing popularity of autonomous unmanned aerial vehicles (UAVs), the improvement of safety for UAV operations has become increasingly important. In this paper, a landing trajectory optimization scheme is proposed to generate reference landing trajectories for a fixed-wing UAV with accidental engine failure. For a specific landing objective, two types of landing trajectory optimization algorithms are investigated: i) trajectory optimization algorithm with nonlinear UAV dynamics, and ii) trajectory optimization algorithm with linearized UAV dynamics. An initialization procedure that generates an initial guess is introduced to accelerate the convergence of the optimization algorithms. The effectiveness of the proposed scheme is verified in a high-fidelity UAV simulation environment, where the optimized landing trajectories are tracked by a UAV equipped with an L1 adaptive altitude controller in both the offline and online modes. 
    more » « less
  5. ; ; ( , 2019 IEEE 20th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM))
    The use of Millimeter-wave (mmWave) spectrum in cellular communications has recently attracted growing interest to support the expected massive increase in traffic demands. However, the high path-loss at mmWave frequencies poses severe challenges. In this paper, we analyze the potential coverage gains of using unmanned aerial vehicles (UAVs), as hovering relays, in integrated access and backhaul (IAB) mmWave cellular scenarios. Specifically, we utilize the WinProp software package, which employs ray tracing methodology, to study the propagation characteristics of outdoor mmWave channels at 30 and 60 GHz frequency bands in a Manhattan-like environment. In doing so, we propose the implementation of amplify-and-forward (AF) and decode-and-forward (DF) relaying mechanisms in the WinProp software. We show how the 3D deployment of UAVs can be defined based on the coverage ray tracing maps at access and backhaul links. Furthermore, we propose an adaptive UAV transmission power for the AF relaying. We demonstrate, with the aid of ray tracing simulations, the performance gains of the proposed relaying modes in terms of downlink coverage, and the received signal to interference and noise ratio (SINR). 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email