:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Lee, Jaeseong, hwang, seung-won, Qiao, Aurick, Campos, Daniel F, Yao, Zhewei, He, Yuxiong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Computation and Language
Accesso online:	https://arxiv.org/abs/2409.06211
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

OWL: Overcoming Window Length-Dependence in Speculative Decoding for Long-Context Inputs
di: Lee, Jaeseong, et al.
Pubblicazione: (2025)

Gold-Switch: Training-Free Superposition of Slow- and Fast- Thinking LLMs
di: Lee, Jaeseong, et al.
Pubblicazione: (2025)

SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation
di: Qiao, Aurick, et al.
Pubblicazione: (2024)

MoE-Prefill: Zero Redundancy Overheads in MoE Prefill Serving
di: Su, Zhaoyuan, et al.
Pubblicazione: (2026)

Condense, Don't Just Prune: Enhancing Efficiency and Performance in MoE Layer Pruning
di: Cao, Mingyu, et al.
Pubblicazione: (2024)

Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences
di: Bekman, Stas, et al.
Pubblicazione: (2025)

$μ$-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts
di: Koike-Akino, Toshiaki, et al.
Pubblicazione: (2025)

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
di: Tang, Shengkun, et al.
Pubblicazione: (2026)

Inference Scaling for Bridging Retrieval and Augmented Generation
di: Lee, Youngwon, et al.
Pubblicazione: (2024)

CORD: Balancing COnsistency and Rank Distillation for Robust Retrieval-Augmented Generation
di: Lee, Youngwon, et al.
Pubblicazione: (2024)

SuffixDecoding: Extreme Speculative Decoding for Emerging AI Applications
di: Oliaro, Gabriele, et al.
Pubblicazione: (2024)

MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router
di: Xie, Yanyue, et al.
Pubblicazione: (2024)

MoE Pathfinder: Trajectory-driven Expert Pruning
di: Yang, Xican, et al.
Pubblicazione: (2025)

Learning to Hint for Reinforcement Learning
di: Xia, Yu, et al.
Pubblicazione: (2026)

MoNE: Replacing Redundant Experts with Lightweight Novices for Structured Pruning of MoE
di: Zhang, Geng, et al.
Pubblicazione: (2025)

AIMER: Calibration-Free Task-Agnostic MoE Pruning
di: Liu, Zongfang, et al.
Pubblicazione: (2026)

SparK: Query-Aware Unstructured Sparsity with Recoverable KV Cache Channel Pruning
di: Liao, Huanxuan, et al.
Pubblicazione: (2025)

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
di: Kolawole, Steven, et al.
Pubblicazione: (2024)

Pruning Weights but Not Truth: Safeguarding Truthfulness While Pruning LLMs
di: Fu, Yao, et al.
Pubblicazione: (2025)

EvoESAP: Non-Uniform Expert Pruning for Sparse MoE
di: Liu, Zongfang, et al.
Pubblicazione: (2026)

MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
di: Manzoni, Andrea
Pubblicazione: (2026)

Think Before You Prune: Self-Reflective Structured Pruning for Reasoning Language Models
di: Wang, Ziyan, et al.
Pubblicazione: (2025)

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning
di: Gao, Shangqian, et al.
Pubblicazione: (2025)

Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning
di: Wang, Zhaoyang, et al.
Pubblicazione: (2026)

Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
di: Gu, Naibin, et al.
Pubblicazione: (2025)

R$^3$-SQL: Ranking Reward and Resampling for Text-to-SQL
di: Han, Hojae, et al.
Pubblicazione: (2026)

Olica: Efficient Structured Pruning of Large Language Models without Retraining
di: He, Jiujun, et al.
Pubblicazione: (2025)

Structured vs. Unstructured Pruning: An Exponential Gap
di: Ferre', Davide, et al.
Pubblicazione: (2026)

SlimMoE: Structured Compression of Large MoE Models via Expert Slimming and Distillation
di: Li, Zichong, et al.
Pubblicazione: (2025)

MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
di: Qin, Jiayu, et al.
Pubblicazione: (2025)

Millions of States: Designing a Scalable MoE Architecture with RWKV-7 Meta-learner
di: Xiao, Liu, et al.
Pubblicazione: (2025)

MoE-Prism: Disentangling Monolithic Experts for Elastic MoE Services via Model-System Co-Designs
di: Xia, Xinfeng, et al.
Pubblicazione: (2025)

SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
di: Muzio, Alexandre, et al.
Pubblicazione: (2024)

GRIN: GRadient-INformed MoE
di: Liu, Liyuan, et al.
Pubblicazione: (2024)

ExCoT: Optimizing Reasoning for Text-to-SQL with Execution Feedback
di: Zhai, Bohan, et al.
Pubblicazione: (2025)

Structured Pruning for Diverse Best-of-N Reasoning Optimization
di: Nguyen, Hieu Trung, et al.
Pubblicazione: (2025)

Deterministic Differentiable Structured Pruning for Large Language Models
di: Huang, Weiyu, et al.
Pubblicazione: (2026)

REAP the Experts: Why Pruning Prevails for One-Shot MoE compression
di: Lasby, Mike, et al.
Pubblicazione: (2025)

LocMoE: A Low-Overhead MoE for Large Language Model Training
di: Li, Jing, et al.
Pubblicazione: (2024)

MoE-SpAc: Efficient MoE Inference Based on Speculative Activation Utility in Heterogeneous Edge Scenarios
di: Li, Shuhuai, et al.
Pubblicazione: (2026)