“…Previously, a rate of convergence of Oð1=k 2 Þ has been proven for the batch version of heavy-ball [7]. Also, Varadarajan et al provided a proof of convergence for the online version of this algorithm in [8]. While this shows that the method converges, the rate of convergence was not given.…”