Copertina

Accelerated Methods with Complexity Separation Under Data Similarity for Federated Learning Problems

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bylinkin, Dmitry, Skorik, Sergey, Bystrov, Dmitriy, Berezin, Leonid, Avetisyan, Aram, Beznosikov, Aleksandr
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Optimization and Control Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2024)

Accelerated Stochastic ExtraGradient: Mixing Hessian and Gradient Similarity to Reduce Communication in Distributed and Federated Learning
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2024)

Local Methods with Adaptivity via Scaling
di: Chezhegov, Savelii, et al.
Pubblicazione: (2024)

Bregman Proximal Method for Efficient Communications under Similarity
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Bant: Byzantine Antidote via Trial Function and Trust Scores
di: Molodtsov, Gleb, et al.
Pubblicazione: (2025)

Enhancing Stability of Physics-Informed Neural Network Training Through Saddle-Point Reformulation
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2025)

Communication-Efficient Federated Learning with Adaptive Number of Participants
di: Skorik, Sergey, et al.
Pubblicazione: (2025)

Accelerated Methods with Compression for Horizontal and Vertical Federated Learning
di: Stanko, Sergey, et al.
Pubblicazione: (2024)

First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Incorporating Preconditioning into Accelerated Approaches: Theoretical Guarantees and Practical Improvement
di: Trifonov, Stepan, et al.
Pubblicazione: (2025)

Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Optimal Data Splitting in Distributed Optimization for Machine Learning
di: Medyakov, Daniil, et al.
Pubblicazione: (2024)

Random-reshuffled SARAH does not need a full gradient computations
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2021)

Effective Method with Compression for Distributed and Federated Cocoercive Variational Inequalities
di: Medyakov, Daniil, et al.
Pubblicazione: (2024)

SSSD-ECG-nle: New Label Embeddings with Structured State-Space Models for ECG generation
di: Skorik, Sergey, et al.
Pubblicazione: (2024)

Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks
di: Solodkin, Vladimir, et al.
Pubblicazione: (2024)

Methods for Optimization Problems with Markovian Stochasticity and Non-Euclidean Geometry
di: Solodkin, Vladimir, et al.
Pubblicazione: (2024)

Stochastic Gradient Methods with Preconditioned Updates
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2022)

Ito Diffusion Approximation of Universal Ito Chains for Sampling, Optimization and Boosting
di: Ustimenko, Aleksei, et al.
Pubblicazione: (2023)

Decentralized Personalized Federated Learning for Min-Max Problems
di: Borodich, Ekaterina, et al.
Pubblicazione: (2021)

Distributed Saddle-Point Problems: Lower Bounds, Near-Optimal and Robust Algorithms
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2020)

Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
di: Veprikov, Andrey, et al.
Pubblicazione: (2025)

Variance Reduction Methods Do Not Need to Compute Full Gradients: Improved Efficiency through Shuffling
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Adaptive Regularized Newton Method with Inexact Hessian
di: Shestakov, Aleksandr, et al.
Pubblicazione: (2025)

Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
di: Chezhegov, Savelii, et al.
Pubblicazione: (2025)

Gradient-Free Approaches is a Key to an Efficient Interaction with Markovian Stochasticity
di: Prokhorov, Boris, et al.
Pubblicazione: (2026)

Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2023)

Hierarchical Mixture-of-Experts with Two-Stage Optimization
di: Molodtsov, Gleb, et al.
Pubblicazione: (2026)

Unified Theory of Adaptive Variance Reduction
di: Shestakov, Aleksandr, et al.
Pubblicazione: (2025)

Exploring New Frontiers in Vertical Federated Learning: the Role of Saddle Point Reformulation
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2026)

Sign-SGD via Parameter-Free Optimization
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Methods for Solving Variational Inequalities with Markovian Stochasticity
di: Solodkin, Vladimir, et al.
Pubblicazione: (2024)

Local SGD for Near-Quadratic Problems: Improving Convergence under Unconstrained Noise Conditions
di: Sadchikov, Andrey, et al.
Pubblicazione: (2024)

Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers
di: Riabinin, Artem, et al.
Pubblicazione: (2026)

WeightLoRA: Keep Only Necessary Adapters
di: Veprikov, Andrey, et al.
Pubblicazione: (2025)

Shuffling Heuristic in Variational Inequalities: Establishing New Convergence Guarantees
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Markovian Compression: Looking to the Past Helps Accelerate the Future
di: Veprikov, Andrey, et al.
Pubblicazione: (2026)

Optimal Analysis of Method with Batching for Monotone Stochastic Finite-Sum Variational Inequalities
di: Pichugin, Alexander, et al.
Pubblicazione: (2024)

On Biased Compression for Distributed Learning
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2020)

New Aspects of Black Box Conditional Gradient: Variance Reduction and One Point Feedback
di: Veprikov, Andrey, et al.
Pubblicazione: (2024)