skip to main content


Title: Lower bound for dilatations: LOWER BOUND FOR DILATATIONS
NSF-PAR ID:
10068899
Author(s) / Creator(s):
 
Publisher / Repository:
Oxford University Press (OUP)
Date Published:
Journal Name:
Journal of Topology
Volume:
11
Issue:
3
ISSN:
1753-8416
Page Range / eLocation ID:
602 to 614
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    We seek tight bounds on the viable parallelism in asynchronous implementations of coordinate descent that achieves linear speedup. We focus on asynchronous coordinate descent (ACD) algorithms on convex functions which consist of the sum of a smooth convex part and a possibly non-smooth separable convex part. We quantify the shortfall in progress compared to the standard sequential stochastic gradient descent. This leads to a simple yet tight analysis of the standard stochastic ACD in a partially asynchronous environment, generalizing and improving the bounds in prior work. We also give a considerably more involved analysis for general asynchronous environments in which the only constraint is that each update can overlap with at most q others. The new lower bound on the maximum degree of parallelism attaining linear speedup is tight and improves the best prior bound almost quadratically. 
    more » « less