Streamlining in the Riemannian Realm: Efficient Riemannian Optimization with Loopless Variance Reduction
Fuente:
arXiv
Guardado en:
| Autores principales: | Demidovich, Yury, Malinovsky, Grigory, Richtárik, Peter |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
MAST: Model-Agnostic Sparsified Training
por: Demidovich, Yury, et al.
Publicado: (2023)
por: Demidovich, Yury, et al.
Publicado: (2023)
Correlated Quantization for Faster Nonconvex Distributed Optimization
por: Panferov, Andrei, et al.
Publicado: (2024)
por: Panferov, Andrei, et al.
Publicado: (2024)
Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
por: Malinovsky, Grigory, et al.
Publicado: (2023)
por: Malinovsky, Grigory, et al.
Publicado: (2023)
FedComLoc: Communication-Efficient Distributed Training of Sparse and Quantized Models
por: Yi, Kai, et al.
Publicado: (2024)
por: Yi, Kai, et al.
Publicado: (2024)
Rennala MVR: Improved Time Complexity for Parallel Stochastic Optimization via Momentum-Based Variance Reduction
por: Tovmasyan, Zhirayr, et al.
Publicado: (2026)
por: Tovmasyan, Zhirayr, et al.
Publicado: (2026)
FedUV: Uniformity and Variance for Heterogeneous Federated Learning
por: Son, Ha Min, et al.
Publicado: (2024)
por: Son, Ha Min, et al.
Publicado: (2024)
Context Parallelism for Scalable Million-Token Inference
por: Yang, Amy, et al.
Publicado: (2024)
por: Yang, Amy, et al.
Publicado: (2024)
Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
por: Wang, Shuai, et al.
Publicado: (2025)
por: Wang, Shuai, et al.
Publicado: (2025)
When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices
por: Zhang, Pengyu, et al.
Publicado: (2024)
por: Zhang, Pengyu, et al.
Publicado: (2024)
Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
por: Li, Yang, et al.
Publicado: (2025)
por: Li, Yang, et al.
Publicado: (2025)
Tackling the Dynamicity in a Production LLM Serving System with SOTA Optimizations via Hybrid Prefill/Decode/Verify Scheduling on Efficient Meta-kernels
por: Song, Mingcong, et al.
Publicado: (2024)
por: Song, Mingcong, et al.
Publicado: (2024)
Federated Learning with Workload Reduction through Partial Training of Client Models and Entropy-Based Data Selection
por: Shi, Hongrui, et al.
Publicado: (2024)
por: Shi, Hongrui, et al.
Publicado: (2024)
Efficient Client Selection in Federated Learning
por: Marfo, William, et al.
Publicado: (2025)
por: Marfo, William, et al.
Publicado: (2025)
Gradient Correction in Federated Learning with Adaptive Optimization
por: Chen, Evan, et al.
Publicado: (2025)
por: Chen, Evan, et al.
Publicado: (2025)
Efficient Federated Learning with Timely Update Dissemination
por: Jia, Juncheng, et al.
Publicado: (2025)
por: Jia, Juncheng, et al.
Publicado: (2025)
Efficient Asynchronous Federated Learning with Sparsification and Quantization
por: Jia, Juncheng, et al.
Publicado: (2023)
por: Jia, Juncheng, et al.
Publicado: (2023)
Efficient and Scalable Agentic AI with Heterogeneous Systems
por: Asgar, Zain, et al.
Publicado: (2025)
por: Asgar, Zain, et al.
Publicado: (2025)
Sampling Parallelism for Fast and Efficient Bayesian Learning
por: Özdemir, Asena Karolin, et al.
Publicado: (2026)
por: Özdemir, Asena Karolin, et al.
Publicado: (2026)
Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
por: Mahran, Ammar, et al.
Publicado: (2026)
por: Mahran, Ammar, et al.
Publicado: (2026)
LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression
por: Condat, Laurent, et al.
Publicado: (2024)
por: Condat, Laurent, et al.
Publicado: (2024)
Optimizing Federated Learning by Entropy-Based Client Selection
por: Lutz, Andreas, et al.
Publicado: (2024)
por: Lutz, Andreas, et al.
Publicado: (2024)
Compass: Optimizing Compound AI Workflows for Dynamic Adaptation
por: Gravara, Milos, et al.
Publicado: (2026)
por: Gravara, Milos, et al.
Publicado: (2026)
Distributed Low-Communication Training with Decoupled Momentum Optimization
por: Nedelkoski, Sasho, et al.
Publicado: (2025)
por: Nedelkoski, Sasho, et al.
Publicado: (2025)
Efficient Training on Multiple Consumer GPUs with RoundPipe
por: Luo, Yibin, et al.
Publicado: (2026)
por: Luo, Yibin, et al.
Publicado: (2026)
Efficient Serving of LLM Applications with Probabilistic Demand Modeling
por: Liu, Yifei, et al.
Publicado: (2025)
por: Liu, Yifei, et al.
Publicado: (2025)
Loss- and Reward-Weighting for Efficient Distributed Reinforcement Learning
por: Holen, Martin, et al.
Publicado: (2023)
por: Holen, Martin, et al.
Publicado: (2023)
Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout
por: Liu, Ji, et al.
Publicado: (2025)
por: Liu, Ji, et al.
Publicado: (2025)
PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices
por: Liu, Yangyijian, et al.
Publicado: (2025)
por: Liu, Yangyijian, et al.
Publicado: (2025)
DIT: Dimension Reduction View on Optimal NFT Rarity Meters
por: Belousov, Dmitry, et al.
Publicado: (2025)
por: Belousov, Dmitry, et al.
Publicado: (2025)
A Survey on Inference Optimization Techniques for Mixture of Experts Models
por: Liu, Jiacheng, et al.
Publicado: (2024)
por: Liu, Jiacheng, et al.
Publicado: (2024)
PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization
por: Wan, Xinyi, et al.
Publicado: (2025)
por: Wan, Xinyi, et al.
Publicado: (2025)
Optimizing video analytics inference pipelines: a case study
por: Ghafouri, Saeid, et al.
Publicado: (2025)
por: Ghafouri, Saeid, et al.
Publicado: (2025)
FedSQ: Optimized Weight Averaging via Fixed Gating
por: Pérez-Corral, Cristian, et al.
Publicado: (2026)
por: Pérez-Corral, Cristian, et al.
Publicado: (2026)
SwiftDiffusion: Efficient Diffusion Model Serving with Add-on Modules
por: Li, Suyi, et al.
Publicado: (2024)
por: Li, Suyi, et al.
Publicado: (2024)
Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices
por: Pfeiffer, Kilian, et al.
Publicado: (2024)
por: Pfeiffer, Kilian, et al.
Publicado: (2024)
Efficient Resource Scheduling for Distributed Infrastructures Using Negotiation Capabilities
por: Chu, Junjie, et al.
Publicado: (2024)
por: Chu, Junjie, et al.
Publicado: (2024)
LCFed: An Efficient Clustered Federated Learning Framework for Heterogeneous Data
por: Zhang, Yuxin, et al.
Publicado: (2025)
por: Zhang, Yuxin, et al.
Publicado: (2025)
Galvatron: An Automatic Distributed System for Efficient Foundation Model Training
por: Liu, Xinyi, et al.
Publicado: (2025)
por: Liu, Xinyi, et al.
Publicado: (2025)
LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)
por: Zhu, Zhanda, et al.
Publicado: (2025)
Hubs and Spokes Learning: Efficient and Scalable Collaborative Machine Learning
por: Sharma, Atul, et al.
Publicado: (2025)
por: Sharma, Atul, et al.
Publicado: (2025)
Ejemplares similares
-
MAST: Model-Agnostic Sparsified Training
por: Demidovich, Yury, et al.
Publicado: (2023) -
Correlated Quantization for Faster Nonconvex Distributed Optimization
por: Panferov, Andrei, et al.
Publicado: (2024) -
Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
por: Malinovsky, Grigory, et al.
Publicado: (2023) -
FedComLoc: Communication-Efficient Distributed Training of Sparse and Quantized Models
por: Yi, Kai, et al.
Publicado: (2024) -
Rennala MVR: Improved Time Complexity for Parallel Stochastic Optimization via Momentum-Based Variance Reduction
por: Tovmasyan, Zhirayr, et al.
Publicado: (2026)