Copertina

Stochastic Constrained Decentralized Optimization for Machine Learning with Fewer Data Oracles: a Gradient Sliding Approach

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Nguyen, Hoang Huy, Li, Yan, Zhao, Tuo
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Optimization and Control Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Local LMO: Constrained Gradient Optimization via a Local Linear Minimization Oracle
di: Richtárik, Peter, et al.
Pubblicazione: (2026)

Multi-level Monte-Carlo Gradient Methods for Stochastic Optimization with Biased Oracles
di: Hu, Yifan, et al.
Pubblicazione: (2024)

Compressed Decentralized Momentum Stochastic Gradient Methods for Nonconvex Optimization
di: Liu, Wei, et al.
Pubblicazione: (2025)

Controllable Expensive Multi-objective Learning with Warm-starting Bayesian Optimization
di: Nguyen, Quang-Huy, et al.
Pubblicazione: (2023)

Stochastic-Constrained Stochastic Optimization with Markovian Data
di: Kim, Yeongjong, et al.
Pubblicazione: (2023)

FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guarantees
di: Nguyen, Hoang T., et al.
Pubblicazione: (2025)

Adaptive Batch Size and Learning Rate Scheduler for Stochastic Gradient Descent Based on Minimization of Stochastic First-order Oracle Complexity
di: Umeda, Hikaru, et al.
Pubblicazione: (2025)

A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2022)

A Homogenization Approach for Gradient-Dominated Stochastic Optimization
di: Tan, Jiyuan, et al.
Pubblicazione: (2023)

High-Probability Convergence in Decentralized Stochastic Optimization with Gradient Tracking
di: Armacki, Aleksandar, et al.
Pubblicazione: (2026)

Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks
di: Nguyen, Duong Thuy Anh, et al.
Pubblicazione: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
di: Gao, Hongchang
Pubblicazione: (2022)

On the Gradient Complexity of Private Optimization with Private Oracles
di: Menart, Michael, et al.
Pubblicazione: (2025)

Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization
di: Li, Huan, et al.
Pubblicazione: (2021)

Optimized Gradient Tracking for Decentralized Online Learning
di: Sharma, Shivangi Dubey, et al.
Pubblicazione: (2023)

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
di: Chen, Hongxu, et al.
Pubblicazione: (2026)

Decentralized Stochastic Nonconvex Optimization under the Relaxed Smoothness
di: Luo, Luo, et al.
Pubblicazione: (2025)

A Stochastic-Gradient-based Interior-Point Algorithm for Solving Smooth Bound-Constrained Optimization Problems
di: Curtis, Frank E., et al.
Pubblicazione: (2023)

humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problems
di: Kliachkin, Andrii, et al.
Pubblicazione: (2025)

Proximal Oracles for Optimization and Sampling
di: Liang, Jiaming, et al.
Pubblicazione: (2024)

Decentralized Optimization on Compact Submanifolds by Quantized Riemannian Gradient Tracking
di: Chen, Jun, et al.
Pubblicazione: (2025)

On Unbalanced Optimal Transport: Gradient Methods, Sparsity and Approximation Error
di: Nguyen, Quang Minh, et al.
Pubblicazione: (2022)

Stochastic Gradient Descent with Adaptive Data
di: Che, Ethan, et al.
Pubblicazione: (2024)

Second-order Conditional Gradient Sliding
di: Carderera, Alejandro, et al.
Pubblicazione: (2020)

Online Convex Optimization with a Separation Oracle
di: Mhammedi, Zakaria
Pubblicazione: (2024)

Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
di: Chen, Lesi, et al.
Pubblicazione: (2025)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
di: Wang, Menglian, et al.
Pubblicazione: (2026)

An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization
di: Chen, Lesi, et al.
Pubblicazione: (2022)

RESIST: Resilient Decentralized Learning Using Consensus Gradient Descent
di: Fang, Cheng, et al.
Pubblicazione: (2025)

Learning to Shuffle: Block Reshuffling and Reversal Schemes for Stochastic Optimization
di: Nguyen, Lam M., et al.
Pubblicazione: (2026)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
di: Vansover-Hager, Shira, et al.
Pubblicazione: (2025)

Bilevel Learning with Inexact Stochastic Gradients
di: Salehi, Mohammad Sadegh, et al.
Pubblicazione: (2024)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
di: Livni, Roi
Pubblicazione: (2024)

Riemannian Stochastic Gradient Method for Nested Composition Optimization
di: Zhang, Dewei, et al.
Pubblicazione: (2022)

Stochastic Non-Smooth Convex Optimization with Unbounded Gradients
di: Kovalev, Dmitry
Pubblicazione: (2026)

HUANet: Hard-Constrained Unrolled ADMM for Constrained Convex Optimization
di: Tran, Trinh, et al.
Pubblicazione: (2026)

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
di: Fernando, Heshan, et al.
Pubblicazione: (2022)

Learning-Augmented Decentralized Online Convex Optimization in Networks
di: Li, Pengfei, et al.
Pubblicazione: (2023)

Online Optimization Perspective on First-Order and Zero-Order Decentralized Nonsmooth Nonconvex Stochastic Optimization
di: Sahinoglu, Emre, et al.
Pubblicazione: (2024)

Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble Approach
di: Yan, Yu-Hu, et al.
Pubblicazione: (2023)