More Like this

1. Gradient Networks

   https://doi.org/10.1109/TSP.2024.3496692  

   Chaudhari, Shreyas; Pranav, Srinivasa; Moura, José_M F (January 2025, IEEE Transactions on Signal Processing)
2. Gradient Sampling Methods with Inexact Subproblem Solutions and Gradient Aggregation

   https://doi.org/10.1287/ijoo.2022.0073  

   Curtis, Frank E.; Li, Minhan (October 2022, INFORMS Journal on Optimization)

   Gradient sampling (GS) methods for the minimization of objective functions that may be nonconvex and/or nonsmooth are proposed, analyzed, and tested. One of the most computationally expensive components of contemporary GS methods is the need to solve a convex quadratic subproblem in each iteration. By contrast, the methods proposed in this paper allow the use of inexact solutions of these subproblems, which, as proved in the paper, can be incorporated without the loss of theoretical convergence guarantees. Numerical experiments show that, by exploiting inexact subproblem solutions, one can consistently reduce the computational effort required by a GS method. Additionally, a strategy is proposed for aggregating gradient information after a subproblem is solved (potentially inexactly) as has been exploited in bundle methods for nonsmooth optimization. It is proved that the aggregation scheme can be introduced without the loss of theoretical convergence guarantees. Numerical experiments show that incorporating this gradient aggregation approach can also reduce the computational effort required by a GS method. 

   more » « less
3. Tree Gradient Coding

   https://doi.org/10.1109/ISIT.2019.8849431  

   Reisizadeh, Amirhossein; Prakash, Saurav; Pedarsani, Ramtin; Avestimehr, Amir Salman (July 2019, 2019 IEEE International Symposium on Information Theory (ISIT))
4. Ranking Policy Gradient

   Lin, Kaixiang; Zhou, Jiayu (April 2020, The Eighth International Conference on Learning Representations (ICLR 2020))

   null (Ed.)
5. Gradient Based Clustering

   Armacki, A.; Bajovic, D.; Jakovetic, D.; Kar, S. (July 2022, International Conference on Machine Learning)