Copertina

Scaffold with Stochastic Gradients: New Analysis with Linear Speed-Up

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Mangold, Paul, Durmus, Alain, Dieuleveut, Aymeric, Moulines, Eric
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Refined Analysis of Federated Averaging and Federated Richardson-Romberg
di: Mangold, Paul, et al.
Pubblicazione: (2024)

Gaussian Approximation and Multiplier Bootstrap for Federated Linear Stochastic Approximation
di: Levin, Ilya, et al.
Pubblicazione: (2026)

Nonasymptotic Analysis of Stochastic Gradient Descent with the Richardson-Romberg Extrapolation
di: Sheshukova, Marina, et al.
Pubblicazione: (2024)

From Inexact Gradients to Byzantine Robustness: Acceleration and Optimization under Similarity
di: Gaucher, Renaud, et al.
Pubblicazione: (2026)

SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning
di: Mangold, Paul, et al.
Pubblicazione: (2024)

Compressed and distributed least-squares regression: convergence rates with applications to Federated Learning
di: Philippenko, Constantin, et al.
Pubblicazione: (2023)

Unified Breakdown Analysis for Byzantine Robust Gossip
di: Gaucher, Renaud, et al.
Pubblicazione: (2024)

A Tight Theory of Error Feedback Algorithms in Distributed Optimization
di: Thomsen, Daniel Berg, et al.
Pubblicazione: (2026)

Federated Majorize-Minimization: Beyond Parameter Aggregation
di: Dieuleveut, Aymeric, et al.
Pubblicazione: (2025)

Tight analyses of first-order methods with error feedback
di: Thomsen, Daniel Berg, et al.
Pubblicazione: (2025)

The Relative Gaussian Mechanism and its Application to Private Gradient Descent
di: Hendrikx, Hadrien, et al.
Pubblicazione: (2023)

Stochastic Approximation with Biased MCMC for Expectation Maximization
di: Gruffaz, Samuel, et al.
Pubblicazione: (2024)

Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time
di: You, Runze, et al.
Pubblicazione: (2025)

Tight Analysis of Decentralized SGD: A Markov Chain Perspective
di: Versini, Lucas, et al.
Pubblicazione: (2026)

Inexact subgradient methods for semialgebraic functions
di: Bolte, Jérôme, et al.
Pubblicazione: (2024)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
di: Lu, Eric
Pubblicazione: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
di: Li, Tianyou, et al.
Pubblicazione: (2023)

PEPit: computer-assisted worst-case analyses of first-order optimization methods in Python
di: Goujaud, Baptiste, et al.
Pubblicazione: (2022)

Open Problem: Two Riddles in Heavy-Ball Dynamics
di: Goujaud, Baptiste, et al.
Pubblicazione: (2025)

Provable non-accelerations of the heavy-ball method
di: Goujaud, Baptiste, et al.
Pubblicazione: (2023)

Counter-examples in first-order optimization: a constructive approach
di: Goujaud, Baptiste, et al.
Pubblicazione: (2023)

Speeding Up Mixed-Integer Programming Solvers with Sparse Learning for Branching
di: Bayramoğlu, Selin, et al.
Pubblicazione: (2026)

Almost Sure Convergence Analysis of Differentially Private Stochastic Gradient Methods
di: Mukherjee, Amartya, et al.
Pubblicazione: (2025)

Beyond Stationarity: Convergence Analysis of Stochastic Softmax Policy Gradient Methods
di: Klein, Sara, et al.
Pubblicazione: (2023)

Stochastic Gradients under Nuisances
di: Yu, Facheng, et al.
Pubblicazione: (2025)

Smart Surrogate Losses for Contextual Stochastic Linear Optimization with Robust Constraints
di: Im, Hyungki, et al.
Pubblicazione: (2025)

Statistical inference for Linear Stochastic Approximation with Markovian Noise
di: Samsonov, Sergey, et al.
Pubblicazione: (2025)

First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
di: Sato, Naoki, et al.
Pubblicazione: (2024)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
di: Beneventano, Pierfrancesco, et al.
Pubblicazione: (2025)

Stochastic Gradient Descent with Strategic Querying
di: Jiang, Nanfei, et al.
Pubblicazione: (2025)

Stochastic Gradient Methods with Preconditioned Updates
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2022)

Stochastic Gradient Descent with Adaptive Data
di: Che, Ethan, et al.
Pubblicazione: (2024)

Demystifying SGD with Doubly Stochastic Gradients
di: Kim, Kyurae, et al.
Pubblicazione: (2024)

Bilevel Learning with Inexact Stochastic Gradients
di: Salehi, Mohammad Sadegh, et al.
Pubblicazione: (2024)

High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise
di: Kar, Avik, et al.
Pubblicazione: (2026)

Optimizing Asynchronous Federated Learning: A Delicate Trade-Off Between Model-Parameter Staleness and Update Frequency
di: Alahyane, Abdelkrim, et al.
Pubblicazione: (2025)

Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization
di: Sato, Naoki, et al.
Pubblicazione: (2023)

Stochastic Adaptive Gradient Descent Without Descent
di: Aujol, Jean-François, et al.
Pubblicazione: (2025)

Stochastic Gradient Langevin Dynamics with Variance Reduction
di: Huang, Zhishen, et al.
Pubblicazione: (2021)