On the $O(\frac{\sqrt{d}}{T^{1/4}})$ Convergence Rate of RMSProp and Its Momentum Extension Measured by $\ell_1$ Norm

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Huan, Dong, Yiming, Lin, Zhouchen
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!