Copertina

Collaborative Compression for Large-Scale MoE Deployment on Edge

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Yixiao, Xie, Yanyue, Yang, Ruining, Jiang, Wei, Wang, Wei, He, Yong, Chen, Yue, Zhao, Pu, Wang, Yanzhi
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router
di: Xie, Yanyue, et al.
Pubblicazione: (2024)

Effective MoE-based LLM Compression by Exploiting Heterogeneous Inter-Group Experts Routing Frequency and Information Density
di: Mi, Zhendong, et al.
Pubblicazione: (2026)

MoE$^2$: Optimizing Collaborative Inference for Edge Large Language Models
di: Jin, Lyudong, et al.
Pubblicazione: (2025)

ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling
di: Yang, Yuchen, et al.
Pubblicazione: (2026)

HybridFlow: Infusing Continuity into Masked Codebook for Extreme Low-Bitrate Image Compression
di: Lu, Lei, et al.
Pubblicazione: (2024)

CoMoE: Collaborative Optimization of Expert Aggregation and Offloading for MoE-based LLMs at Edge
di: Li, Muqing, et al.
Pubblicazione: (2025)

KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models
di: Xu, Zukang, et al.
Pubblicazione: (2026)

SMoE: An Algorithm-System Co-Design for Pushing MoE to the Edge via Expert Substitution
di: Zhu, Guoying, et al.
Pubblicazione: (2025)

FFT-MoE: Efficient Federated Fine-Tuning for Foundation Models via Large-scale Sparse MoE under Heterogeneous Edge
di: Hu, Gang, et al.
Pubblicazione: (2025)

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models
di: Wang, Siqi, et al.
Pubblicazione: (2024)

Squat: Quant Small Language Models on the Edge
di: Shen, Xuan, et al.
Pubblicazione: (2024)

AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies
di: Zhang, Bo-Wen, et al.
Pubblicazione: (2024)

Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
di: Li, Yunxin, et al.
Pubblicazione: (2025)

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory
di: Wu, Haoze, et al.
Pubblicazione: (2024)

GazeFormer-MoE: Context-Aware Gaze Estimation via CLIP and MoE Transformer
di: Zhao, Xinyuan, et al.
Pubblicazione: (2026)

LLaDA-MoE: A Sparse MoE Diffusion Language Model
di: Zhu, Fengqi, et al.
Pubblicazione: (2025)

ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Model
di: Xu, Yuhao, et al.
Pubblicazione: (2026)

LocMoE: A Low-Overhead MoE for Large Language Model Training
di: Li, Jing, et al.
Pubblicazione: (2024)

ReviveMoE: Fast Recovery for Hardware Failures in Large-Scale MoE LLM Inference Deployments
di: Li, Haley, et al.
Pubblicazione: (2026)

Noise-Robustness Through Noise: A Framework combining Asymmetric LoRA with Poisoning MoE
di: Wang, Zhaokun, et al.
Pubblicazione: (2025)

Exploiting the Experts: Unauthorized Compression in MoE-LLMs
di: Neogi, Pinaki Prasad Guha, et al.
Pubblicazione: (2025)

Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs
di: Zhang, Wuyue, et al.
Pubblicazione: (2026)

Breaking the MoE LLM Trilemma: Dynamic Expert Clustering with Structured Compression
di: Zhu, Peijun, et al.
Pubblicazione: (2025)

FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edge
di: Shen, Xuan, et al.
Pubblicazione: (2025)

PWC-MoE: Privacy-Aware Wireless Collaborative Mixture of Experts
di: Su, Yang, et al.
Pubblicazione: (2025)

COME: Dual Structure-Semantic Learning with Collaborative MoE for Universal Lesion Detection Across Heterogeneous Ultrasound Datasets
di: Chen, Lingyu, et al.
Pubblicazione: (2025)

Sigma-MoE-Tiny Technical Report
di: Hu, Qingguo, et al.
Pubblicazione: (2025)

Hierarchical LoRA MoE for Efficient CTR Model Scaling
di: Zeng, Zhichen, et al.
Pubblicazione: (2025)

Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observations
di: Jaiswal, Ajay, et al.
Pubblicazione: (2025)

SecMoE: Communication-Efficient Secure MoE Inference via Select-Then-Compute
di: Shen, Bowen, et al.
Pubblicazione: (2026)

DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance
di: Shen, Xuan, et al.
Pubblicazione: (2025)

MoE-SpAc: Efficient MoE Inference Based on Speculative Activation Utility in Heterogeneous Edge Scenarios
di: Li, Shuhuai, et al.
Pubblicazione: (2026)

EAC-MoE: Expert-Selection Aware Compressor for Mixture-of-Experts Large Language Models
di: Chen, Yuanteng, et al.
Pubblicazione: (2025)

Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent
di: Sun, Xingwu, et al.
Pubblicazione: (2024)

Open-Source Acceleration of Stable-Diffusion.cpp Deployable on All Devices
di: Ng, Jingxu, et al.
Pubblicazione: (2024)

Verbal Werewolf: Engage Users with Verbalized Agentic Werewolf Game Framework
di: Fan, Qihui, et al.
Pubblicazione: (2025)

Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
di: Li, Yunxin, et al.
Pubblicazione: (2024)

SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities
di: Xia, Guoyang, et al.
Pubblicazione: (2025)

Adapted-MoE: Mixture of Experts with Test-Time Adaption for Anomaly Detection
di: Lei, Tianwu, et al.
Pubblicazione: (2024)

Cross-Platform Scaling of Vision-Language-Action Models from Edge to Cloud GPUs
di: Taherin, Amir, et al.
Pubblicazione: (2025)