Cover Image

Mixture of Experts in Image Classification: What's the Sweet Spot?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Videau, Mathurin, Leite, Alessandro, Schoenauer, Marc, Teytaud, Olivier
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evolutionary Retrofitting
by: Videau, Mathurin, et al.
Published: (2024)

Evolutionary Pre-Prompt Optimization for Mathematical Reasoning
by: Videau, Mathurin, et al.
Published: (2024)

Tuning without Peeking: Provable Generalization Bounds and Robust LLM Post-Training
by: Labiad, Ismail, et al.
Published: (2025)

From Bytes to Ideas: Language Modeling with Autoregressive U-Nets
by: Videau, Mathurin, et al.
Published: (2025)

Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
by: Oldfield, James, et al.
Published: (2024)

Video Relationship Detection Using Mixture of Experts
by: Shaabana, Ala, et al.
Published: (2024)

Robust Experts: the Effect of Adversarial Training on CNNs with Sparse Mixture-of-Experts Layers
by: Pavlitska, Svetlana, et al.
Published: (2025)

LPT++: Efficient Training on Mixture of Long-tailed Experts
by: Dong, Bowen, et al.
Published: (2024)

EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
by: Cheng, Anzhe, et al.
Published: (2026)

Stable Routing for Mixture-of-Experts in Class-Incremental Learning
by: Guo, Zirui, et al.
Published: (2026)

Mixture-of-Experts Models in Vision: Routing, Optimization, and Generalization
by: Rokah, Adam, et al.
Published: (2026)

Extracting Uncertainty Estimates from Mixtures of Experts for Semantic Segmentation
by: Pavlitska, Svetlana, et al.
Published: (2025)

Mixture of Group Experts for Learning Invariant Representations
by: Kang, Lei, et al.
Published: (2025)

Merging Multi-Task Models via Weight-Ensembling Mixture of Experts
by: Tang, Anke, et al.
Published: (2024)

Domain-Specialized Object Detection via Model-Level Mixtures of Experts
by: Pavlitska, Svetlana, et al.
Published: (2026)

Efficient Training of Diffusion Mixture-of-Experts Models: A Practical Recipe
by: Liu, Yahui, et al.
Published: (2025)

Lightweight Metadata-Aware Mixture-of-Experts Masked Autoencoder for Earth Observation
by: Albughdadi, Mohanad
Published: (2025)

Masked and Shuffled Blind Spot Denoising for Real-World Images
by: Chihaoui, Hamadi, et al.
Published: (2024)

SpotEdit: Evaluating Visually-Guided Image Editing Methods
by: Ghazanfari, Sara, et al.
Published: (2025)

Beyond Accuracy: What Matters in Designing Well-Behaved Image Classification Models?
by: Hesse, Robin, et al.
Published: (2025)

Task-customized Masked AutoEncoder via Mixture of Cluster-conditional Experts
by: Liu, Zhili, et al.
Published: (2024)

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging
by: Shen, Li, et al.
Published: (2024)

Towards Adversarial Robustness of Model-Level Mixture-of-Experts Architectures for Semantic Segmentation
by: Pavlitska, Svetlana, et al.
Published: (2024)

Scaling Continual Learning to 300+ Tasks with Bi-Level Routing Mixture-of-Experts
by: Lou, Meng, et al.
Published: (2026)

MoTE: Mixture of Ternary Experts for Memory-efficient Large Multimodal Models
by: Wang, Hongyu, et al.
Published: (2025)

Design and Behavior of Sparse Mixture-of-Experts Layers in CNN-based Semantic Segmentation
by: Pavlitska, Svetlana, et al.
Published: (2026)

From Sparse to Soft Mixtures of Experts
by: Puigcerver, Joan, et al.
Published: (2023)

Mixture-of-Experts for Open Set Domain Adaptation: A Dual-Space Detection Approach
by: Du, Zhenbang, et al.
Published: (2023)

CLIP-UP: A Simple and Efficient Mixture-of-Experts CLIP Training Recipe with Sparse Upcycling
by: Wang, Xinze, et al.
Published: (2025)

Routers in Vision Mixture of Experts: An Empirical Study
by: Liu, Tianlin, et al.
Published: (2024)

AMEND: A Mixture of Experts Framework for Long-tailed Trajectory Prediction
by: Mercurius, Ray Coden, et al.
Published: (2024)

Pixel-Wise Symbol Spotting via Progressive Points Location for Parsing CAD Images
by: Pang, Junbiao, et al.
Published: (2024)

MixAR: Mixture Autoregressive Image Generation
by: Hu, Jinyuan, et al.
Published: (2025)

MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging
by: Qiu, Zihuan, et al.
Published: (2025)

Unified Cross-Modal Medical Image Synthesis with Hierarchical Mixture of Product-of-Experts
by: Dorent, Reuben, et al.
Published: (2024)

Expert Race: A Flexible Routing Strategy for Scaling Diffusion Transformer with Mixture of Experts
by: Yuan, Yike, et al.
Published: (2025)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
by: Yang, Minghao, et al.
Published: (2025)

Mixture of Nested Experts: Adaptive Processing of Visual Tokens
by: Jain, Gagan, et al.
Published: (2024)

MAM-CLIP: Vision-Language Pretraining on Mammography Atlases for BI-RADS Classification
by: Gulluk, Halil Ibrahim, et al.
Published: (2026)

Mixture of Experts Made Personalized: Federated Prompt Learning for Vision-Language Models
by: Luo, Jun, et al.
Published: (2024)