Imagen de Portada

The case for and against fixed step-size: Stochastic approximation algorithms in optimization and machine learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lauand, Caio Kalil, Kontoyiannis, Ioannis, Meyn, Sean
Formato:	Preprint
Publicado:	2023
Materias:	Statistics Theory Machine Learning 62L20, 68T05
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Revisiting Step-Size Assumptions in Stochastic Approximation
por: Lauand, Caio Kalil, et al.
Publicado: (2024)

The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning
por: Borkar, Vivek, et al.
Publicado: (2021)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
por: Lauand, Caio Kalil, et al.
Publicado: (2025)

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging
por: Lauand, Caio Kalil, et al.
Publicado: (2022)

Markovian Foundations for Quasi-Stochastic Approximation with Applications to Extremum Seeking Control
por: Lauand, Caio Kalil, et al.
Publicado: (2022)

Optimistic Training and Convergence of Q-Learning -- Extended Version
por: Mehta, Prashant, et al.
Publicado: (2026)

On-line Pick-Freeze Mirror algorithm for Sensitity Analysis
por: Costa, Manon, et al.
Publicado: (2025)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
por: Sakha, Masoud S., et al.
Publicado: (2026)

On Lai's Upper Confidence Bound in Multi-Armed Bandits
por: Ren, Huachen, et al.
Publicado: (2024)

Kernel $ε$-Greedy for Multi-Armed Bandits with Covariates
por: Arya, Sakshi, et al.
Publicado: (2023)

Statistical inference for Linear Stochastic Approximation with Markovian Noise
por: Samsonov, Sergey, et al.
Publicado: (2025)

Conformal e-testing
por: Vovk, Vladimir, et al.
Publicado: (2020)

Truncated Kernel Stochastic Gradient Descent with General Losses and Spherical Radial Basis Functions
por: Bai, Jinhui, et al.
Publicado: (2025)

Imbalanced Classification under Capacity Constraints
por: Fraiman, Daniel, et al.
Publicado: (2026)

Kernel Single-Index Bandits: Estimation, Inference, and Learning
por: Arya, Sakshi, et al.
Publicado: (2026)

Extensions of the regret-minimization algorithm for optimal design
por: Chen, Youguang, et al.
Publicado: (2025)

Improved Central Limit Theorem and Bootstrap Approximations for Linear Stochastic Approximation
por: Butyrin, Bogdan, et al.
Publicado: (2025)

Online jump and kink detection in segmented linear regression: Statistical optimality meets computational efficiency
por: Hüselitz, Annika, et al.
Publicado: (2025)

Gaussian Approximation and Multiplier Bootstrap for Polyak-Ruppert Averaged Linear Stochastic Approximation with Applications to TD Learning
por: Samsonov, Sergey, et al.
Publicado: (2024)

Stochastic approximation method for kernel sliced average variance estimation
por: Nkou, Emmanuel De Dieu
Publicado: (2024)

Computing conservative probabilities of rare events with surrogates
por: Bousquet, Nicolas
Publicado: (2024)

Validity and efficiency of the conformal CUSUM procedure
por: Vovk, Vladimir, et al.
Publicado: (2024)

seMCD: Sequentially implemented Monte Carlo depth computation with statistical guarantees
por: Gnettner, Felix, et al.
Publicado: (2025)

Bayesian Optimality of In-Context Learning with Selective State Spaces
por: Zhang, Di, et al.
Publicado: (2026)

Least squares approximations in linear statistical inverse learning problems
por: Helin, Tapio
Publicado: (2022)

Two approaches to multiple canonical correlation analysis for repeated measures data
por: Górecki, Tomasz, et al.
Publicado: (2025)

An Efficient Adaptive Sequential Procedure for Simple Hypotheses with Expression for Finite Number of Applications of Less Effective Treatment
por: Kundu, Sampurna, et al.
Publicado: (2025)

Truncated Kernel Stochastic Gradient Descent on Spheres
por: Bai, Jinhui, et al.
Publicado: (2024)

Online Regularized Learning Algorithms in RKHS with $β$- and $ϕ$-Mixing Sequences
por: Roy, Priyanka, et al.
Publicado: (2025)

Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
por: Dexheimer, Niklas, et al.
Publicado: (2024)

Convergence guarantees for forward gradient descent in the linear regression model
por: Bos, Thijs, et al.
Publicado: (2023)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
por: Butyrin, Bogdan, et al.
Publicado: (2025)

A studentized permutation test in group sequential designs
por: Xu, Long-Hao, et al.
Publicado: (2024)

Uniform convergence of kernel averages under fixed design with heterogeneous dependent data
por: Matsuoka, Danilo Hiroshi, et al.
Publicado: (2026)

Error analysis for learning fractional stochastic differential equations with applications in neural approximations
por: Dehshiri, Mahdi, et al.
Publicado: (2026)

Quantile-Scaled Bayesian Optimization Using Rank-Only Feedback
por: Egunjobi, Tunde Fahd
Publicado: (2025)

Batched Nonparametric Bandits via k-Nearest Neighbor UCB
por: Arya, Sakshi
Publicado: (2025)

Adaptive monotonicity testing in sublinear time
por: Li, Housen, et al.
Publicado: (2025)

Lower bounds for the trade-off between bias and mean absolute deviation
por: Derumigny, Alexis, et al.
Publicado: (2023)

The Nonparametric Kiefer-Weiss Problem
por: Fauss, Michael, et al.
Publicado: (2026)