Cover Image

SAME: Stabilized Mixture-of-Experts for Multimodal Continual Instruction Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xie, Zhen-Hao, Tang, Jun-Tao, Shi, Yu-Cheng, Ye, Han-Jia, Zhan, De-Chuan, Zhou, Da-Wei
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning
by: Tang, Jun-Tao, et al.
Published: (2026)

CRAM: Centroid-Routing and Adaptive MoE for Multimodal Continual Instruction Tuning
by: Tang, Jun-Tao, et al.
Published: (2026)

ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning
by: Shi, Yu-Cheng, et al.
Published: (2026)

Dynamic Cross-Modal Prompt Generation for Multimodal Continual Instruction Tuning
by: Hu, Tao, et al.
Published: (2026)

Addressing Imbalanced Domain-Incremental Learning through Dual-Balance Collaborative Experts
by: Li, Lan, et al.
Published: (2025)

Capability Instruction Tuning: A New Paradigm for Dynamic LLM Routing
by: Zhang, Yi-Kai, et al.
Published: (2025)

Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
by: Ge, Chendi, et al.
Published: (2025)

Cross-Sample Relational Fusion: Unifying Domain Generalization and Class-Incremental Learning
by: Xie, Zhen-Hao, et al.
Published: (2026)

PILOT: A Pre-Trained Model-Based Continual Learning Toolbox
by: Sun, Hai-Long, et al.
Published: (2023)

Parrot: Multilingual Visual Instruction Tuning
by: Sun, Hai-Long, et al.
Published: (2024)

Continual Learning with Pre-Trained Models: A Survey
by: Zhou, Da-Wei, et al.
Published: (2024)

SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Experts
by: Zhou, Gengze, et al.
Published: (2024)

BOFA: Bridge-Layer Orthogonal Low-Rank Fusion for CLIP-Based Class-Incremental Learning
by: Li, Lan, et al.
Published: (2025)

Task-Agnostic Guided Feature Expansion for Class-Incremental Learning
by: Zheng, Bowen, et al.
Published: (2025)

Hierarchical Representation Matching for CLIP-based Class-Incremental Learning
by: Wen, Zhen-Hao, et al.
Published: (2025)

Polaris: Scaling Up Instruction-Guided Image Generation Towards Millions of Personalized Style Needs
by: Chen, Zhi-Kai, et al.
Published: (2026)

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
by: Zhu, Tong, et al.
Published: (2024)

Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning
by: Zhou, Da-Wei, et al.
Published: (2024)

TV100: A TV Series Dataset that Pre-Trained CLIP Has Not Seen
by: Zhou, Da-Wei, et al.
Published: (2024)

MCITlib: Multimodal Continual Instruction Tuning Library and Benchmark
by: Guo, Haiyang, et al.
Published: (2025)

Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
by: Guo, Yongxin, et al.
Published: (2024)

Multimodal Instruction Tuning with Conditional Mixture of LoRA
by: Shen, Ying, et al.
Published: (2024)

MAny: Merge Anything for Multimodal Continual Instruction Tuning
by: Gao, Zijian, et al.
Published: (2026)

Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning
by: Eo, Sugyeong, et al.
Published: (2025)

Federated Continual Instruction Tuning
by: Guo, Haiyang, et al.
Published: (2025)

Stable Routing for Mixture-of-Experts in Class-Incremental Learning
by: Guo, Zirui, et al.
Published: (2026)

Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping
by: Jiang, Chenyu, et al.
Published: (2024)

Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need
by: Zhou, Da-Wei, et al.
Published: (2023)

Dual Consolidation for Pre-Trained Model-Based Domain-Incremental Learning
by: Zhou, Da-Wei, et al.
Published: (2024)

Adaptive Adapter Routing for Long-Tailed Class-Incremental Learning
by: Qi, Zhi-Hong, et al.
Published: (2024)

Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts
by: He, Xin, et al.
Published: (2025)

AREA: Attribute Extraction and Aggregation for CLIP-Based Class-Incremental Learning
by: Xie, Zhen-Hao, et al.
Published: (2026)

HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model
by: Guo, Haiyang, et al.
Published: (2025)

XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
by: Ding, Yifeng, et al.
Published: (2024)

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning
by: Han, Xing, et al.
Published: (2026)

Revisiting Content-Based Music Recommendation: Efficient Feature Aggregation from Large-Scale Music Models
by: Zhou, Yizhi, et al.
Published: (2026)

PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
by: Liu, Yilun, et al.
Published: (2024)

Aurora:Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning
by: Wang, Rongsheng, et al.
Published: (2023)

One-Embedding-Fits-All: Efficient Zero-Shot Time Series Forecasting by a Model Zoo
by: Shi, Hao-Nan, et al.
Published: (2025)

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer
by: Zheng, Junhao, et al.
Published: (2024)