Bias-Variance Trade-offs for Averaged SGD in Least Mean Squares

Posted on:

This article is on the work by Défossez and Bach 2014, in which the authors develop an operator view point for analyzing Averaged SGD updates to show the Bias-Variance Trade-off and provide tight convergence rates of Least Mean Squared problem.

The complete PDF post can be viewed here.

Leave a Comment