More Like this

1. Covariance-Aware Private Mean Estimation Without Private Covariance Estimation

   Brown, Gavin; Gaboardi, Marco; Smith, Adam; Ullman, Jonathan; Zakynthinou, Lydia (January 2021, Advances in neural information processing systems)
2. Covariance-Aware Private Mean Estimation Without Private Covariance Estimation

   Brown, Gavin; Gaboardi, Marco; Smith, Adam; Ullman, Jonathan; Zakynthinou, Lydia (December 2021, Advances in Neural Information Processing Systems 34 (NeurIPS 2021))
3. Covariance-Aware Private Mean Estimation Without Private Covariance Estimation

   Brown, Gavin; Gaboardi, Marco; Smith, Adam; Ullman, Jonathan; Zakynthinou, Lydia (January 2021, Advances in neural information processing systems)
4. coVariance Neural Networks

   Sihag, Saurabh; Mateos, Gonzalo; McMillan, Corey; Ribeiro, Alejandro (October 2022, Advances in neural information processing systems)
5. coVariance Neural Networks

   Sihag, Saurabh; Mateos, Gonzalo; McMillan, Corey; Ribeiro, Alejandro (October 2022, Advances in neural information processing systems)

   Oh, Alice; Agarwal, Alekh; Belgrave, Danielle; Cho, Kyunghyun (Ed.)

   Graph neural networks (GNN) are an effective framework that exploit inter-relationships within graph-structured data for learning. Principal component analysis (PCA) involves the projection of data on the eigenspace of the covariance matrix and draws similarities with the graph convolutional filters in GNNs. Motivated by this observation, we study a GNN architecture, called coVariance neural network (VNN), that operates on sample covariance matrices as graphs. We theoretically establish the stability of VNNs to perturbations in the covariance matrix, thus, implying an advantage over standard PCA-based data analysis approaches that are prone to instability due to principal components associated with close eigenvalues. Our experiments on real-world datasets validate our theoretical results and show that VNN performance is indeed more stable than PCA-based statistical approaches. Moreover, our experiments on multi-resolution datasets also demonstrate that VNNs are amenable to transferability of performance over covariance matrices of different dimensions; a feature that is infeasible for PCA-based approaches. 

   more » « less