Constant Stepsize Local GD for Logistic Regression: Acceleration by Instability
Fuente:
arXiv
Saved in:
| Main Authors: | Crawshaw, Michael, Woodworth, Blake, Liu, Mingrui |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Local Steps Speed Up Local GD for Heterogeneous Distributed Logistic Regression
by: Crawshaw, Michael, et al.
Published: (2025)
by: Crawshaw, Michael, et al.
Published: (2025)
Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension
by: Crawshaw, Michael, et al.
Published: (2026)
by: Crawshaw, Michael, et al.
Published: (2026)
Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)
by: Wu, Jingfeng, et al.
Published: (2025)
Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness
by: Crawshaw, Michael, et al.
Published: (2025)
by: Crawshaw, Michael, et al.
Published: (2025)
Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis
by: Crawshaw, Michael, et al.
Published: (2024)
by: Crawshaw, Michael, et al.
Published: (2024)
An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
by: Crawshaw, Michael, et al.
Published: (2025)
by: Crawshaw, Michael, et al.
Published: (2025)
Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes
by: Zhang, Ruiqi, et al.
Published: (2025)
by: Zhang, Ruiqi, et al.
Published: (2025)
Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
by: Beneventano, Pierfrancesco, et al.
Published: (2025)
by: Beneventano, Pierfrancesco, et al.
Published: (2025)
Constant Stepsize Q-learning: Distributional Convergence, Bias and Extrapolation
by: Zhang, Yixuan, et al.
Published: (2024)
by: Zhang, Yixuan, et al.
Published: (2024)
Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes
by: Huo, Dongyan, et al.
Published: (2022)
by: Huo, Dongyan, et al.
Published: (2022)
Whittle Index Learning Algorithms for Restless Bandits with Constant Stepsizes
by: Mittal, Vishesh, et al.
Published: (2024)
by: Mittal, Vishesh, et al.
Published: (2024)
The Collusion of Memory and Nonlinearity in Stochastic Approximation With Constant Stepsize
by: Huo, Dongyan, et al.
Published: (2024)
by: Huo, Dongyan, et al.
Published: (2024)
Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency
by: Wu, Jingfeng, et al.
Published: (2024)
by: Wu, Jingfeng, et al.
Published: (2024)
Steady-State Behavior of Constant-Stepsize Stochastic Approximation: Gaussian Approximation and Tail Bounds
by: Wang, Zedong, et al.
Published: (2026)
by: Wang, Zedong, et al.
Published: (2026)
Compact Memory for Continual Logistic Regression
by: Jung, Yohan, et al.
Published: (2025)
by: Jung, Yohan, et al.
Published: (2025)
Efficient Logistic Regression with Mixture of Sigmoids
by: Di Gennaro, Federico, et al.
Published: (2026)
by: Di Gennaro, Federico, et al.
Published: (2026)
Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way
by: Kwon, Jeongyeol, et al.
Published: (2024)
by: Kwon, Jeongyeol, et al.
Published: (2024)
Riemannian Multinomial Logistics Regression for SPD Neural Networks
by: Chen, Ziheng, et al.
Published: (2023)
by: Chen, Ziheng, et al.
Published: (2023)
F-measure Maximizing Logistic Regression
by: Okabe, Masaaki, et al.
Published: (2019)
by: Okabe, Masaaki, et al.
Published: (2019)
Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
by: Wu, Haotian
Published: (2025)
by: Wu, Haotian
Published: (2025)
Near-Polynomially Competitive Active Logistic Regression
by: Zhou, Yihan, et al.
Published: (2025)
by: Zhou, Yihan, et al.
Published: (2025)
An Experiment on Feature Selection using Logistic Regression
by: Islam, Raisa, et al.
Published: (2024)
by: Islam, Raisa, et al.
Published: (2024)
Residue-based Label Protection Mechanisms in Vertical Logistic Regression
by: Tan, Juntao, et al.
Published: (2022)
by: Tan, Juntao, et al.
Published: (2022)
Grokking in Linear Models for Logistic Regression
by: Das, Nataraj, et al.
Published: (2026)
by: Das, Nataraj, et al.
Published: (2026)
Non-Euclidean Gradient Descent Operates at the Edge of Stability
by: Islamov, Rustem, et al.
Published: (2026)
by: Islamov, Rustem, et al.
Published: (2026)
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
by: Gong, Xiaochuan, et al.
Published: (2024)
by: Gong, Xiaochuan, et al.
Published: (2024)
LFFR: Logistic Function For (single-output) Regression
by: Chiang, John
Published: (2024)
by: Chiang, John
Published: (2024)
$L_1$-norm Regularized Indefinite Kernel Logistic Regression
by: Wang, Shaoxin, et al.
Published: (2025)
by: Wang, Shaoxin, et al.
Published: (2025)
Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)
by: Wu, Jingfeng, et al.
Published: (2025)
Data-Driven Logistic Regression Ensembles With Applications in Genomics
by: Christidis, Anthony-Alexander, et al.
Published: (2021)
by: Christidis, Anthony-Alexander, et al.
Published: (2021)
Interpretable Predictive Models for Healthcare via Rational Logistic Regression
by: Suttaket, Thiti, et al.
Published: (2024)
by: Suttaket, Thiti, et al.
Published: (2024)
Mixed-feature Logistic Regression Robust to Distribution Shifts
by: Sun, Qingshi, et al.
Published: (2025)
by: Sun, Qingshi, et al.
Published: (2025)
Semi-parametric Functional Classification via Path Signatures Logistic Regression
by: Zeng, Pengcheng, et al.
Published: (2025)
by: Zeng, Pengcheng, et al.
Published: (2025)
RMLR: Extending Multinomial Logistic Regression into General Geometries
by: Chen, Ziheng, et al.
Published: (2024)
by: Chen, Ziheng, et al.
Published: (2024)
AdaGrad Meets Muon: Adaptive Stepsizes for Orthogonal Updates
by: Zhang, Minxin, et al.
Published: (2025)
by: Zhang, Minxin, et al.
Published: (2025)
Minibatch and Local SGD: Algorithmic Stability and Linear Speedup in Generalization
by: Lei, Yunwen, et al.
Published: (2023)
by: Lei, Yunwen, et al.
Published: (2023)
Stochastic Approximation with Block Coordinate Optimal Stepsizes
by: Jiang, Tao, et al.
Published: (2025)
by: Jiang, Tao, et al.
Published: (2025)
On Suppressing Range of Adaptive Stepsizes of Adam to Improve Generalisation Performance
by: Zhang, Guoqiang
Published: (2023)
by: Zhang, Guoqiang
Published: (2023)
Posterior Approximation using Stochastic Gradient Ascent with Adaptive Stepsize
by: Lim, Kart-Leong, et al.
Published: (2024)
by: Lim, Kart-Leong, et al.
Published: (2024)
Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
by: Zhang, Chenyang, et al.
Published: (2026)
by: Zhang, Chenyang, et al.
Published: (2026)
Similar Items
-
Local Steps Speed Up Local GD for Heterogeneous Distributed Logistic Regression
by: Crawshaw, Michael, et al.
Published: (2025) -
Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension
by: Crawshaw, Michael, et al.
Published: (2026) -
Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025) -
Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness
by: Crawshaw, Michael, et al.
Published: (2025) -
Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis
by: Crawshaw, Michael, et al.
Published: (2024)