skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Analog Joint Source-Channel Coding for Distributed Functional Compression using Deep Neural Networks
In this paper, we study Joint Source-Channel Coding (JSCC) for distributed analog functional compression over both Gaussian Multiple Access Channel (MAC) and AWGN channels. Notably, we propose a deep neural network based solution for learning encoders and decoders. We propose three methods of increasing performance. The first one frames the problem as an autoencoder; the second one incorporates the power constraint in the objective by using a Lagrange multiplier; the third method derives the objective from the information bottleneck principle. We show that all proposed methods are variational approximations to upper bounds on the indirect rate-distortion problem’s minimization objective. Further, we show that the third method is the variational approximation of a tighter upper bound compared to the other two. Finally, we show empirical performance results for image classification. We compare with existing work and showcase the performance improvement yielded by the proposed methods.  more » « less
Award ID(s):
2003002
PAR ID:
10293685
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
IEEE International Symposium on Information Theory
Page Range / eLocation ID:
2429 to 2434
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, IEEE Transactions on Wireless Communications)
    Reconfigurable arrays mold the propagation en- vironment to benefit wireless systems. We use single-port polarization-reconfigurable antennas in a wideband multiple- input multiple-output (MIMO) system and demonstrate the efficacy of reconfiguration techniques based on analytical channel models. We apply a double-directional channel model to show that polarization reconfiguration acts as an additional precoding step on an unpolarized channel. We use Jensen’s inequality to upper bound the spectral efficiency and leverage the relaxed objective to derive closed-form expressions for the optimal polarization angles at each antenna. We also derive upper bounds on the performance of a polarization reconfigurable system and develop an efficient procedure for polarization reconfiguration that aims to maximize these upper bounds. Numerical results show that the proposed simplified methods achieve near-optimal in wideband MIMO settings. 
    more » « less
  2. ; ; (, international conference on machine learning)
    Batch Bayesian optimization has been shown to be an efficient and successful approach for black-box function optimization, especially when the evaluation of cost function is highly expensive but can be efficiently parallelized. In this paper, we introduce a novel variational framework for batch query optimization, based on the argument that the query batch should be selected to have both high diversity and good worst case performance. This motivates us to introduce a variational objective that combines a quantile-based risk measure (for worst case performance) and entropy regularization (for enforcing diversity). We derive a gradient-based particle-based algorithm for solving our quantile-based variational objective, which generalizes Stein variational gradient descent (SVGD). We evaluate our method on a number of real-world applications and show that it consistently outperforms other recent state-of-the-art batch Bayesian optimization methods. Extensive experimental results indicate that our method achieves better or comparable performance, compared to the existing methods. 
    more » « less
  3. ; ; (, Entropy)
    Information bottleneck (IB) is a technique for extracting information in one random variable X that is relevant for predicting another random variable Y. IB works by encoding X in a compressed “bottleneck” random variable M from which Y can be accurately decoded. However, finding the optimal bottleneck variable involves a difficult optimization problem, which until recently has been considered for only two limited cases: discrete X and Y with small state spaces, and continuous X and Y with a Gaussian joint distribution (in which case optimal encoding and decoding maps are linear). We propose a method for performing IB on arbitrarily-distributed discrete and/or continuous X and Y, while allowing for nonlinear encoding and decoding maps. Our approach relies on a novel non-parametric upper bound for mutual information. We describe how to implement our method using neural networks. We then show that it achieves better performance than the recently-proposed “variational IB” method on several real-world datasets. 
    more » « less
  4. ; ; (, IEEE Transactions on Signal Processing)
    Massive multiple-input multiple-output (MIMO) communications using low-resolution analog-to-digital converters (ADCs) is a promising technology for providing high spectral and energy efficiency with affordable hardware cost and power consumption. However, the use of low-resolution ADCs requires special signal processing methods for channel estimation and data detection since the resulting system is severely non-linear. This paper proposes joint channel estimation and data detection methods for massive MIMO systems with low-resolution ADCs based on the variational Bayes (VB) inference framework. We first derive matched-filter quantized VB (MF-QVB) and linear minimum mean-squared error quantized VB (LMMSE-QVB) detection methods assuming the channel state information (CSI) is available. Then we extend these methods to the joint channel estimation and data detection (JED) problem and propose two methods we refer to as MF-QVB-JED and LMMSE-QVB-JED. Unlike conventional VB-based detection methods that assume knowledge of the second-order statistics of the additive noise, we propose to float the elements of the noise covariance matrix as unknown random variables that are used to account for both the noise and the residual inter-user interference. We also present practical aspects of the QVB framework to improve its implementation stability. Finally, we show via numerical results that the proposed VB-based methods provide robust performance and also significantly outperform existing methods. 
    more » « less
  5. ; (, IEEE Global Conference on Signal and Information Processing)
    In this paper, we propose a robust analog-only beamforming scheme for the downlink multi-user systems, which not only suppresses the interference and enhances the beamforming gain, but also provides robustness against imperfect channel state information (CSI). We strike a balance between the average beamforming gain and the inter-user interference by formulating a multi-objective problem. A probabilistic objective of leakage interference power is formulated to alleviate the effects of the channel estimation and feedback quantization errors. To solve the problem, we first use the sum-weighted method to transform the multi-objective problem into a single-objective problem. Then, we use the semi-definite programing technique to make the constantmagnitude constraints of the analog beamforming tractable. Simulation results show that our proposed robust beamformer can provide up to 120% improvement in the sum-rate compared to the beam selection method. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email