Image de couverture de livre

Rethinking LLM Ensembling from the Perspective of Mixture Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fu, Jiale, Jiang, Yuchu, Wu, Peijun, Liu, Chonghan, Zhou, Joey Tianyi, Yang, Xu
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Fast Large Language Model Collaborative Decoding via Speculation
par: Fu, Jiale, et autres
Publié: (2025)

Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free
par: Li, Ziyue, et autres
Publié: (2024)

d$^2$Cache: Accelerating Diffusion-Based LLMs via Dual Adaptive Caching
par: Jiang, Yuchu, et autres
Publié: (2025)

Rethinking Data Mixing from the Perspective of Large Language Models
par: Xu, Yuanjian, et autres
Publié: (2026)

Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial?
par: Li, Wenzhe, et autres
Publié: (2025)

Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theory
par: Liu, Yexiang, et autres
Publié: (2025)

DiscoUQ: Structured Disagreement Analysis for Uncertainty Quantification in LLM Agent Ensembles
par: Jiang, Bo
Publié: (2026)

LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversity
par: Tekin, Selim Furkan, et autres
Publié: (2024)

Understanding the Thinking Process of Reasoning Models: A Perspective from Schoenfeld's Episode Theory
par: Li, Ming, et autres
Publié: (2025)

Pre-trained Large Language Models Use Fourier Features to Compute Addition
par: Zhou, Tianyi, et autres
Publié: (2024)

MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
par: Liu, Zehua, et autres
Publié: (2025)

LLM Router: Rethinking Routing with Prefill Activations
par: Varshney, Tanay, et autres
Publié: (2026)

Rethinking Local Learning: A Cheaper and Faster Recipe for LLM Post-Training
par: Shi, Hengyu, et autres
Publié: (2026)

Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
par: Pan, Bowen, et autres
Publié: (2024)

Rethinking LLM Evaluation: Can We Evaluate LLMs with 200x Less Data?
par: Wang, Shaobo, et autres
Publié: (2025)

Rethinking Machine Unlearning for Large Language Models
par: Liu, Sijia, et autres
Publié: (2024)

Rethinking Token Prediction: Tree-Structured Diffusion Language Model
par: Wu, Zihao, et autres
Publié: (2026)

SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture
par: Han, Jiayi, et autres
Publié: (2024)

Automated Alignment of Math Items to Content Standards in Large-Scale Assessments Using Language Models
par: Xu, Qingshu, et autres
Publié: (2025)

Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective
par: Zhang, Yanan, et autres
Publié: (2024)

When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification
par: Zhao, Jiale, et autres
Publié: (2026)

Rethinking Token Reduction for State Space Models
par: Zhan, Zheng, et autres
Publié: (2024)

PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
par: Huang, Yangyi, et autres
Publié: (2026)

Sentence-level Reward Model can Generalize Better for Aligning LLM from Human Preference
par: Qiu, Wenjie, et autres
Publié: (2025)

GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models
par: Zheng, Chen, et autres
Publié: (2025)

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
par: Zeng, Hanqing, et autres
Publié: (2025)

Flatter Tokens are More Valuable for Speculative Draft Model Training
par: Fan, Jiaming, et autres
Publié: (2026)

MoPD: Mixture-of-Prompts Distillation for Vision-Language Models
par: Chen, Yang, et autres
Publié: (2024)

A Closer Look into Mixture-of-Experts in Large Language Models
par: Lo, Ka Man, et autres
Publié: (2024)

RevOrder: A Novel Method for Enhanced Arithmetic in Language Models
par: Shen, Si, et autres
Publié: (2024)

CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning
par: Feng, Jinyuan, et autres
Publié: (2025)

OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning
par: Feng, Jinyuan, et autres
Publié: (2025)

Rethinking LLM Memorization through the Lens of Adversarial Compression
par: Schwarzschild, Avi, et autres
Publié: (2024)

A Survey on Mixture of Experts in Large Language Models
par: Cai, Weilin, et autres
Publié: (2024)

What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
par: Li, Ming, et autres
Publié: (2024)

GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding
par: Yan, Yibo, et autres
Publié: (2024)

HMoE: Heterogeneous Mixture of Experts for Language Modeling
par: Wang, An, et autres
Publié: (2024)

Critical Data Size of Language Models from a Grokking Perspective
par: Zhu, Xuekai, et autres
Publié: (2024)

Kinetics: Rethinking Test-Time Scaling Laws
par: Sadhukhan, Ranajoy, et autres
Publié: (2025)

Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Models
par: Wang, Zihan, et autres
Publié: (2025)