skip to main content


Title: Adaptive Switching for Multimodal Underwater Acoustic Communications Based on Reinforcement Learning
The underwater acoustic (UWA) channel is a complex and stochastic process with large spatial and temporal dynamics. This work studies the adaptation of the communication strategy to the channel dynamics. Specifically, a set of communication strategies are considered, including frequency shift keying (FSK), single-carrier communication, and multicarrier communication. Based on the channel condition, a reinforcement learning (RL) algorithm, the Depth Determined Strategy Gradient (DDPG) method along with a Gumbel-softmax scheme is employed for intelligent and adaptive switching among those communication strategies. The adaptive switching is performed on a transmission block-by-block basis, with the goal of maximizing a long-term system performance. The reward function is defined based on the energy efficiency and the spectral efficiency of the communication strategies. Simulation results reveal that the proposed method outperforms a random selection method in time-varying channels.  more » « less
Award ID(s):
1651135
NSF-PAR ID:
10314505
Author(s) / Creator(s):
;
Date Published:
Journal Name:
the 15th International Conference on Underwater Networks & Systems (WUWNet)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Achieving high throughput and reliability in underwater acoustic networks is a challenging task due to the bandwidth-limited and unpredictable nature of the channel. In a multi-node structure, such as in the Internet of Underwater Things (IoUT), the efficiency of links varies dynamically because of the channel variations. When the channel is not in good condition, e.g., when in deep fade, channel-coding techniques fail to deliver the required information even with multiple rounds of retransmissions. An efficient and agile collaborative strategy among the nodes is required to assign appropriate resources to each link based on their status and capability. Hence, a cross-layer collaborative strategy is introduced to increase the throughput of the network by allocating unequal share of system resources to different nodes/links. The proposed solution adjusts the physical- and link-layer parameters in a collaborative manner for a Code Division Multiple Access (CDMA)-based underwater network. An adaptive Hybrid Automatic Repeat Request (HARQ) solution is employed to guarantee reliable communications against errors in poor communication links. Results are being validated using data collected from the LOON underwater testbed, which is hosted by the NATO STO Centre for Maritime Research and Experimentation (CMRE) in La Spezia, Italy. 
    more » « less
  2. null (Ed.)
    The resource-constrained nature of the Internet of Things (IoT) edges, poses a challenge in designing a secure and high-performance communication for this family of devices. Although side-channel resistant ciphers (either block or stream) could guarantee the security of the communication, the energy intensive nature of these ciphers makes them undesirable for lightweight IoT solutions. In this paper, we introduce ExTru, an encrypted communication protocol based on stream ciphers that adds a configurable switching & toggling network (CSTN) to not only boost the performance of the communication in these devices, it also consumes far less energy than the conventional side-channel resistant ciphers. Although the overall structure of the proposed scheme is leaky against physical attacks, we introduce a dynamic encryption mechanism that removes this vulnerability. We demonstrate how each communicated message in the proposed scheme reduces the level of trust. Accordingly, since a specific number of messages, N, could break the communication and extract the key, by using the dynamic encryption mechanism, ExTru can re-initiate the level of trust periodically after T messages where T <; N, to protect the communication against side-channel and scan-based attacks (e.g. SAT attack). Furthermore, we demonstrate that by properly configuring the value of T, ExTru not only increases the strength of security from per “device” to per “message”, it also significantly improves energy saving as well as throughput vs. an architecture that only uses a conventional side-channel resistant block/stream cipher. 
    more » « less
  3. null (Ed.)
    Adaptive communication for Internet of Things (IoT) and Wireless Body Area Network (WBAN) technologies is becoming increasingly popular due to the large power-performance trade-offs and highly dynamic channel conditions. Path loss, low signal to noise ratio (SNR) in the channel and network congestion adversely affect the data communication, each of which can be taken care of using different strategies such as reducing the data rate (for reducing congestion), increasing the output power (for increased path loss) and application of error correction coding (ECC, for low SNR). In this paper, we present a digital-friendly Transceiver SoC consisting of an RF-DAC based transmitter with orthogonally tunable output power, data rate and ECC that enables optimum system level bit error rate (BER) and energy for over 3-orders of energy-performance scalability, along with an ultra-low-power OOK receiver that receives the transmitter's control bits from a nearby base station for closed-loop control. The data rate and ECC control is achieved through a digital baseband, while a tapped capacitor matching network controls the output power. The energy efficiency of the transmitter is 27.6pJ/b at 10MSps and at 0.8V supply (~9X improvement over state-of-the-art), while the entire SoC (Transmitter+OOK receiver for controller feedback) consumes only 41.5pJ/b. 
    more » « less
  4. Wireless networks in agricultural environments are unique in many ways. Recent measurements reveal that the dynamics of crop growth impact wireless propagation channels with a long-term seasonal pattern. Additionally, short-term environmental factors, such as strong wind, result in variations in channel statistics. Next-generation agricultural fields, populated by autonomous tractors, drones, and high-throughput sensing systems, require high-throughput connectivity infrastructure, resulting in the future deployment of high-frequency networks, where they have not been deployed before. More specifically, when millimeter-wave (mmWave) communication systems, a viable candidate for 5G and 6G high-throughput solutions, are deployed for higher throughput, these issues become more prominent due to the relatively small wavelength at this frequency band. To improve coverage in the mmWave spectrum in agricultural settings, reconfigurable intelligent surfaces (RISs) are a promising solution with low energy consumption and high cost efficiency when compared to half-duplex active relays with multiple antennas. To ensure link resiliency under dynamic channel behavior, an adaptive RIS for broadband wireless agricultural networks (AgRIS) at mmWave band is designed in this work. AgRIS relies on output from a time-series model that forecasts the short-term wind speed based on measured wind data, which is readily available in most farms. The temporal correlation between link reliability and wind speed is demonstrated through extensive field experiments. Our simulation results demonstrate that AgRIS with a small footprint of 11 × 11 elements can help mitigate the adversarial effects of wind-induced signal level drop by up to 8 dB and provides high energy efficiency of 1 Gbits/joule. 
    more » « less
  5. A decentralized adaptive scheme is proposed for protection coordination of microgrids. In the proposed scheme, a set of agents around the fault location negotiate with each other to reach the best protection coordination strategy upon the occurrence of a fault. Adopting a protective layer, agents are arranged in a number of groups where the members in each group can interact with each other. Considering the operational uncertainties of the respective circuit breakers and communication links, the best fault clearance strategy is determined by analyzing the probability of correct operation of all proposed strategies and considering the least number of probable outages. This is done by calculating the fault currents flowing through the respective circuit breakers and the Latency of the communication links. The efficiency of the proposed scheme is demonstrated by comparing the simulation results of a sample network with those obtained using the conventional central adaptive protection approach. 
    more » « less