Cover Image

Convergence of Riemannian Stochastic Gradient Descents: Varying Batch Sizes And Nonstandard Batch Forming

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Wu, Hao
Format:	Preprint
Published:	2026
Subjects:	Optimization and Control 41A60, 53Z50, 62L20, 68T05
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive Stochastic Gradient Descents on Manifolds with an Application on Weighted Low-Rank Approximation
by: Yang, Peiqi, et al.
Published: (2025)

Mini-Batch Covariance, Diffusion Limits, and Oracle Complexity in Stochastic Gradient Descent: A Sampling-Design Perspective
by: Zantedeschi, Daniel, et al.
Published: (2026)

Revisiting Stochastic Approximation and Stochastic Gradient Descent
by: Karandikar, Rajeeva Laxman, et al.
Published: (2025)

Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
by: Gess, Benjamin, et al.
Published: (2024)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
by: Sheshukova, Marina, et al.
Published: (2025)

Retraction based regression methods on Riemannian manifolds
by: Loayza-Romero, Estefanía, et al.
Published: (2026)

Markov Chain Gradient Descent in Hilbert Spaces
by: Roy, Priyanka, et al.
Published: (2024)

Statistical inference for Linear Stochastic Approximation with Markovian Noise
by: Samsonov, Sergey, et al.
Published: (2025)

Convergence of Batch Asynchronous Stochastic Approximation With Applications to Reinforcement Learning
by: Karandikar, Rajeeva L., et al.
Published: (2021)

Iso-Riemannian Optimization on Learned Data Manifolds
by: Diepeveen, Willem, et al.
Published: (2025)

Convergence Rates for Stochastic Approximation: Biased Noise with Unbounded Variance, and Applications
by: Karandikar, Rajeeva L., et al.
Published: (2023)

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
by: Butyrin, Bogdan, et al.
Published: (2025)

Gradient Descent Algorithm in Hilbert Spaces under Stationary Markov Chains with $ϕ$- and $β$-Mixing
by: Roy, Priyanka, et al.
Published: (2025)

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning
by: Samsonov, Sergey, et al.
Published: (2024)

Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation
by: Sheshukova, Marina, et al.
Published: (2024)

Optimistic Training and Convergence of Q-Learning -- Extended Version
by: Mehta, Prashant, et al.
Published: (2026)

Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data
by: Diepeveen, Willem, et al.
Published: (2026)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
by: Butyrin, Bogdan, et al.
Published: (2025)

Truncated Kernel Stochastic Gradient Descent with General Losses and Spherical Radial Basis Functions
by: Bai, Jinhui, et al.
Published: (2025)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
by: Lauand, Caio Kalil, et al.
Published: (2025)

An Iterative Bayesian Robbins--Monro Sequence
by: Liu, Siwei, et al.
Published: (2025)

Convergence of Markov Chains for Constant Step-size Stochastic Gradient Descent with Separable Functions
by: Shirokoff, David, et al.
Published: (2024)

Optimal Quantization of Finite Uniform Data on the Sphere
by: Roychowdhury, Mrinal Kanti
Published: (2026)

A Short Survey of Averaging Techniques in Stochastic Gradient Methods
by: Lakshmanan, K.
Published: (2026)

Truncated Kernel Stochastic Gradient Descent on Spheres
by: Bai, Jinhui, et al.
Published: (2024)

An adaptive adjoint-oriented neural network for solving parametric optimal control problems with singularities
by: Yuan, Zikang, et al.
Published: (2025)

Interpolatory Dynamical Low-Rank Approximation: Theoretical Foundations and Algorithms
by: Carrel, Benjamin, et al.
Published: (2025)

Achieving Universal Approximation and Universal Interpolation via Nonlinearity of Control Families
by: Cai, Yongqiang, et al.
Published: (2025)

Mean-field games with rough common noise: the linear-quadratic case
by: Friz, Peter K., et al.
Published: (2026)

On the existence of minimizers in shallow residual ReLU neural network optimization landscapes
by: Dereich, Steffen, et al.
Published: (2023)

On the existence of optimal shallow feedforward networks with ReLU activation
by: Dereich, Steffen, et al.
Published: (2023)

When Does Dynamic Preconditioning Preserve the Polyak-Ruppert CLT? A Stabilization Threshold
by: An, Sunyoung, et al.
Published: (2026)

On the Rate of Gaussian Approximation for Linear Regression Problems
by: Khusainov, Marat, et al.
Published: (2025)

Online Regularized Learning Algorithms in RKHS with $β$- and $ϕ$-Mixing Sequences
by: Roy, Priyanka, et al.
Published: (2025)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
by: Sakha, Masoud S., et al.
Published: (2026)

Blessing of Dimensionality for Approximating Sobolev Classes on Manifolds
by: Tan, Hong Ye, et al.
Published: (2024)

Improved High-Probability Bounds for the Temporal Difference Learning Algorithm via Exponential Stability
by: Samsonov, Sergey, et al.
Published: (2023)

A Riemannian quasi-Newton algorithm for optimization with Euclidean bounds
by: Baran, Mateusz, et al.
Published: (2026)

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning
by: Borkar, Vivek, et al.
Published: (2021)

Geometric shape matching for recovering protein conformations from single-particle Cryo-EM data
by: Jansson, Erik, et al.
Published: (2024)