Imagen de Portada

FastMMoE: Accelerating Multimodal Large Language Models through Dynamic Expert Activation and Routing-Aware Token Pruning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xia, Guoyang, Ding, Yifeng, Li, Fengfa, Ren, Lei, Chen, Wei, Feng, Fangxiang, Wang, Xiaojie
Formato:	Preprint
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities
por: Xia, Guoyang, et al.
Publicado: (2025)

MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
por: Yu, Haofei, et al.
Publicado: (2023)

ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference
por: Ouyang, Haojie, et al.
Publicado: (2025)

FastVID: Dynamic Density Pruning for Fast Video Large Language Models
por: Shen, Leqi, et al.
Publicado: (2025)

QAPruner: Quantization-Aware Vision Token Pruning for Multimodal Large Language Models
por: Wang, Xinhao, et al.
Publicado: (2026)

Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?
por: Wen, Zichen, et al.
Publicado: (2025)

Lngram: N-gram Conditional Memory in Latent Space
por: Zheng, Yunao, et al.
Publicado: (2026)

DiffHarmony: Latent Diffusion Model Meets Image Harmonization
por: Zhou, Pengfei, et al.
Publicado: (2024)

MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer
por: Cao, Jianjian, et al.
Publicado: (2024)

Fast-Slow Efficient Training for Multimodal Large Language Models via Visual Token Pruning
por: Zhang, Dingkun, et al.
Publicado: (2026)

Concept Conductor: Orchestrating Multiple Personalized Concepts in Text-to-Image Synthesis
por: Yao, Zebin, et al.
Publicado: (2024)

MoDES: Accelerating Mixture-of-Experts Multimodal Large Language Models via Dynamic Expert Skipping
por: Huang, Yushi, et al.
Publicado: (2025)

Route Experts by Sequence, not by Token
por: Wen, Tiansheng, et al.
Publicado: (2025)

FreeGraftor: Training-Free Cross-Image Feature Grafting for Subject-Driven Text-to-Image Generation
por: Yao, Zebin, et al.
Publicado: (2025)

Routing Experts: Learning to Route Dynamic Experts in Multi-modal Large Language Models
por: Wu, Qiong, et al.
Publicado: (2024)

EntropyPrune: Matrix Entropy Guided Visual Token Pruning for Multimodal Large Language Models
por: Wang, Yahong, et al.
Publicado: (2026)

TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models
por: Lee, Jaewoo, et al.
Publicado: (2025)

Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models
por: Ye, Weihao, et al.
Publicado: (2024)

Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing
por: Le, Qi, et al.
Publicado: (2025)

HieraVid: Hierarchical Token Pruning for Fast Video Large Language Models
por: Guo, Yansong, et al.
Publicado: (2026)

MMoE: Robust Spoiler Detection with Multi-modal Information and Domain-aware Mixture-of-Experts
por: Zeng, Zinan, et al.
Publicado: (2024)

Saliency-driven Dynamic Token Pruning for Large Language Models
por: Tao, Yao, et al.
Publicado: (2025)

HeadRouter: Dynamic Head-Weight Routing for Task-Adaptive Audio Token Pruning in Large Audio Language Models
por: He, Peize, et al.
Publicado: (2026)

TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model
por: Yang, Cheng, et al.
Publicado: (2025)

DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models
por: Alvar, Saeed Ranjbar, et al.
Publicado: (2025)

Accelerating Multimodal Large Language Models by Searching Optimal Vision Token Reduction
por: Zhao, Shiyu, et al.
Publicado: (2024)

FastAV: Efficient Token Pruning for Audio-Visual Large Language Model Inference
por: Jung, Chaeyoung, et al.
Publicado: (2026)

Decoupled Similarity for Task-Aware Token Pruning in Large Vision-Language Models
por: Ma, Kexin, et al.
Publicado: (2026)

Opportunistic Expert Activation: Batch-Aware Expert Routing for Faster Decode Without Retraining
por: Oncescu, Costin-Andrei, et al.
Publicado: (2025)

Accelerating Matrix Factorization by Dynamic Pruning for Fast Recommendation
por: Wu, Yining, et al.
Publicado: (2024)

TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal Models
por: Zhang, Hao, et al.
Publicado: (2025)

How Confident Is the First Token? An Uncertainty-Calibrated Prompt Optimization Framework for Large Language Model Classification and Understanding
por: Chen, Wei, et al.
Publicado: (2026)

Mixture of States: Routing Token-Level Dynamics for Multimodal Generation
por: Liu, Haozhe, et al.
Publicado: (2025)

SEAP: Training-free Sparse Expert Activation Pruning Unlock the Brainpower of Large Language Models
por: Liang, Xun, et al.
Publicado: (2025)

HAWK: Head Importance-Aware Visual Token Pruning in Multimodal Models
por: Zhu, Qihui, et al.
Publicado: (2026)

Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings
por: Wu, Qiong, et al.
Publicado: (2024)

Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models
por: Liu, Zheyuan, et al.
Publicado: (2025)

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning
por: Gao, Shangqian, et al.
Publicado: (2025)

DynaMMo: Dynamic Model Merging for Efficient Class Incremental Learning for Medical Images
por: Qazi, Mohammad Areeb, et al.
Publicado: (2024)

AdaTP: Attention-Debiased Token Pruning for Video Large Language Models
por: Sun, Fengyuan, et al.
Publicado: (2025)