Copertina

DHO$_2$: Accelerating Distributed Hybrid Order Optimization via Model Parallelism and ADMM

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Gu, Shunxian, You, Chaoqun, Ren, Bangbang, Luo, Lailong, Xia, Junxu, Guo, Deke
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Communication and Computation Efficient Split Federated Learning in O-RAN
di: Gu, Shunxian, et al.
Pubblicazione: (2025)

Analytic Personalized Federated Meta-Learning
di: Gu, Shunxian, et al.
Pubblicazione: (2025)

Sensing and Storing Less: A MARL-based Solution for Energy Saving in Edge Internet of Things
di: Yuan, Zongyang, et al.
Pubblicazione: (2025)

Parallel Collaborative ADMM Privacy Computing and Adaptive GPU Acceleration for Distributed Edge Networks
di: Xia, Mengchun, et al.
Pubblicazione: (2026)

Accelerating Heterogeneous Tensor Parallelism via Flexible Workload Control
di: Wang, Zhigang, et al.
Pubblicazione: (2024)

Parallel Order-Based Core Maintenance in Dynamic Graphs
di: Guo, Bin, et al.
Pubblicazione: (2022)

Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization
di: Guo, Kun, et al.
Pubblicazione: (2025)

BandPilot: Towards Performance- and Contention-Aware GPU Dispatching in AI Clusters
di: Zhang, Kunming, et al.
Pubblicazione: (2025)

Heimdall++: Optimizing GPU Utilization and Pipeline Parallelism for Efficient Single-Pulse Detection
di: Xia, Bingzheng, et al.
Pubblicazione: (2025)

Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization
di: Li, Haoyang, et al.
Pubblicazione: (2024)

Distributed Constraint-Coupled Optimization: Harnessing ADMM-consensus for robustness
di: Messilem, Mohamed Abdelmouamin, et al.
Pubblicazione: (2025)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
di: Chen, Qiaoling, et al.
Pubblicazione: (2024)

EXaCTz: Guaranteed Extremum Graph and Contour Tree Preservation for Distributed- and GPU-Parallel Lossy Compression
di: Li, Yuxiao, et al.
Pubblicazione: (2026)

Matryoshka: Optimization of Dynamic Diverse Quantum Chemistry Systems via Elastic Parallelism Transformation
di: Wang, Tuowei, et al.
Pubblicazione: (2024)

Staleness-Centric Optimizations for Parallel Diffusion MoE Inference
di: Luo, Jiajun, et al.
Pubblicazione: (2024)

MixServe: An Automatic Distributed Serving System for MoE Models with Hybrid Parallelism Based on Fused Communication Algorithm
di: Zhou, Bowen, et al.
Pubblicazione: (2026)

Accelerating Microswimmer Simulations via a Heterogeneous Pipelined Parallel-in-Time Framework
di: Huang, Ruixiang, et al.
Pubblicazione: (2026)

DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization
di: Tang, Zhenheng, et al.
Pubblicazione: (2025)

Accelerating Edge Inference for Distributed MoE Models with Latency-Optimized Expert Placement
di: Wu, Tian, et al.
Pubblicazione: (2025)

ResiHP: Taming LLM Training Failures with Dynamic Hybrid Parallelism
di: Ma, Tenghui, et al.
Pubblicazione: (2026)

pMSz: A Distributed Parallel Algorithm for Correcting Extrema and Morse Smale Segmentations in Lossy Compression
di: Li, Yuxiao, et al.
Pubblicazione: (2026)

Parallel Reduced Order Modeling for Digital Twins using High-Performance Computing Workflows
di: de Parga, S. Ares, et al.
Pubblicazione: (2024)

DynaFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling
di: Pan, Yi, et al.
Pubblicazione: (2026)

A Comparative Review of Parallel Exact, Heuristic, Metaheuristic, and Hybrid Optimization Techniques for the Traveling Salesman Problem
di: Alkhalifa, Rabab, et al.
Pubblicazione: (2025)

NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism
di: Ai, Xin, et al.
Pubblicazione: (2024)

Acceleration of Parallel Tempering for Markov Chain Monte Carlo methods
di: Ramos, Aingeru, et al.
Pubblicazione: (2025)

Hybrid-Parallel: Achieving High Performance and Energy Efficient Distributed Inference on Robots
di: Sun, Zekai, et al.
Pubblicazione: (2024)

Accelerating OpenPangu Inference on NPU via Speculative Decoding
di: Dai, Yuntao, et al.
Pubblicazione: (2026)

Herring: Parallel Batch-Order-Fairness on DAG-based Blockchain Consensus
di: Putnik, Marko, et al.
Pubblicazione: (2026)

Optimizing Long-context LLM Serving via Fine-grained Sequence Parallelism
di: Li, Cong, et al.
Pubblicazione: (2025)

Hyperion: Hierarchical Scheduling for Parallel LLM Acceleration in Multi-tier Networks
di: Ma, Mulei, et al.
Pubblicazione: (2025)

LuWu: An End-to-End In-Network Out-of-Core Optimizer for 100B-Scale Model-in-Network Data-Parallel Training on Distributed GPUs
di: Sun, Mo, et al.
Pubblicazione: (2024)

CoCoDiff: Optimizing Collective Communications for Distributed Diffusion Transformer Inference Under Ulysses Sequence Parallelism
di: Ma, Bin, et al.
Pubblicazione: (2026)

Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization
di: Zhu, Zhanda, et al.
Pubblicazione: (2025)

gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
di: Guo, Tianyu, et al.
Pubblicazione: (2025)

GPU-Accelerated Distributed QAOA on Large-scale HPC Ecosystems
di: Xu, Zhihao, et al.
Pubblicazione: (2025)

Adaptra: Straggler-Resilient Hybrid-Parallel Training with Pipeline Adaptation
di: Wu, Tianyuan, et al.
Pubblicazione: (2025)

HAP: Hybrid Adaptive Parallelism for Efficient Mixture-of-Experts Inference
di: Lin, Haoran, et al.
Pubblicazione: (2025)

CFP: Efficient Optimization of Intra-Operator Parallelism Plans for Large Model Training
di: Hu, Weifang, et al.
Pubblicazione: (2025)

Distributed Semi-Speculative Parallel Anisotropic Mesh Adaptation
di: Garner, Kevin, et al.
Pubblicazione: (2026)