Imagen de Portada

A Double Tracking Method for Optimization with Decentralized Generalized Orthogonality Constraints

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Lei, Xiao, Nachuan, Liu, Xin
Formato:	Preprint
Publicado:	2024
Materias:	Optimization and Control Distributed, Parallel, and Cluster Computing Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
por: Zhou, Yuan, et al.
Publicado: (2025)

A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks
por: Yau, Chung-Yiu, et al.
Publicado: (2024)

Communication-Efficient Federated Optimization over Semi-Decentralized Networks
por: Wang, He, et al.
Publicado: (2023)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
por: Dong, Youran, et al.
Publicado: (2023)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
por: Yin, Chao, et al.
Publicado: (2026)

A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming
por: Nazari, Parvin, et al.
Publicado: (2022)

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
por: Wang, Jing, et al.
Publicado: (2025)

A Hybrid Stochastic Gradient Tracking Method for Distributed Online Optimization Over Time-Varying Directed Networks
por: Shi, Xinli, et al.
Publicado: (2025)

Decentralized Directed Collaboration for Personalized Federated Learning
por: Liu, Yingqi, et al.
Publicado: (2024)

Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks
por: Song, Zhuoqing, et al.
Publicado: (2021)

A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
por: Hu, Yuchen, et al.
Publicado: (2025)

A Communication and Computation Efficient Fully First-order Method for Decentralized Bilevel Optimization
por: Wen, Min, et al.
Publicado: (2024)

On Principled Local Optimization Methods for Federated Learning
por: Yuan, Honglin
Publicado: (2024)

Energy-efficient Decentralized Learning via Graph Sparsification
por: Zhang, Xusheng, et al.
Publicado: (2024)

Decentralized Personalized Federated Learning for Min-Max Problems
por: Borodich, Ekaterina, et al.
Publicado: (2021)

Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggering
por: Zehtabi, Shahryar, et al.
Publicado: (2022)

Optimality in Decentralized Optimization under Bandwidth Constraints
por: Tyurin, Alexander
Publicado: (2026)

Time-varying Mixing Matrix Design for Energy-efficient Decentralized Federated Learning
por: Zhang, Xusheng, et al.
Publicado: (2025)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
por: Bylinkin, Dmitry, et al.
Publicado: (2024)

Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization
por: Lin, Zhenwei, et al.
Publicado: (2023)

An Optimistic Gradient Tracking Method for Distributed Minimax Optimization
por: Huang, Yan, et al.
Publicado: (2025)

CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence
por: Huang, Kun, et al.
Publicado: (2023)

Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization
por: Qin, Zhen, et al.
Publicado: (2023)

AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix
por: Yue, Yun, et al.
Publicado: (2023)

Local Methods with Adaptivity via Scaling
por: Chezhegov, Savelii, et al.
Publicado: (2024)

Birch SGD: A Tree Graph Framework for Local and Asynchronous SGD Methods
por: Tyurin, Alexander, et al.
Publicado: (2025)

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
por: Yang, Junchi, et al.
Publicado: (2024)

Efficient Adaptive Federated Optimization
por: Lee, Su Hyeong, et al.
Publicado: (2024)

CONGO: Compressive Online Gradient Optimization
por: Carleton, Jeremy, et al.
Publicado: (2024)

Decentralized Distributed Optimization for Saddle Point Problems
por: Rogozin, Alexander, et al.
Publicado: (2021)

Decentralized Nonsmooth Nonconvex Optimization with Client Sampling
por: Chen, Xinyan, et al.
Publicado: (2026)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
por: Sadiev, Abdurakhmon, et al.
Publicado: (2026)

Towards Dynamic Resource Allocation and Client Scheduling in Hierarchical Federated Learning: A Two-Phase Deep Reinforcement Learning Approach
por: Chen, Xiaojing, et al.
Publicado: (2024)

Optimizing LLM Inference: Fluid-Guided Online Scheduling with Memory Constraints
por: Ao, Ruicheng, et al.
Publicado: (2025)

Optimizing Stochastic Gradient Push under Broadcast Communications
por: Nguyen, Tuan, et al.
Publicado: (2026)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
por: Maranjyan, Artavazd, et al.
Publicado: (2022)

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
por: Li, Jiaxiang, et al.
Publicado: (2024)

Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes
por: Huang, Yan, et al.
Publicado: (2024)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
por: He, Yutong, et al.
Publicado: (2023)

Unbiased Compression Saves Communication in Distributed Optimization: When and How Much?
por: He, Yutong, et al.
Publicado: (2023)