skip to main content


Title: Weighted Matrix Completion From Non-Random, Non-Uniform Sampling Patterns
Award ID(s):
1934319
NSF-PAR ID:
10294119
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
IEEE Transactions on Information Theory
Volume:
67
Issue:
2
ISSN:
0018-9448
Page Range / eLocation ID:
1264 to 1290
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a (δ,ϵ)-stationary point from O(ϵ^(-4),δ^(-1)) stochastic gradient queries to O(ϵ^(-3),δ^(-1)), which we also show to be optimal. Our primary technique is a reduction from non-smooth non-convex optimization to online learning, after which our results follow from standard regret bounds in online learning. For deterministic and second-order smooth objectives, applying more advanced optimistic online learning techniques enables a new complexity of O(ϵ^(-1.5),δ^(-0.5)). Our techniques also recover all optimal or best-known results for finding ϵ stationary points of smooth or second-order smooth objectives in both stochastic and deterministic settings. 
    more » « less