Cover Image

Multimodal Instruction Tuning with Conditional Mixture of LoRA

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shen, Ying, Xu, Zhiyang, Wang, Qifan, Cheng, Yu, Yin, Wenpeng, Huang, Lifu
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
by: Ge, Chendi, et al.
Published: (2025)

Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuning
by: Gou, Yunhao, et al.
Published: (2023)

Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning
by: Xu, Zhiyang, et al.
Published: (2024)

LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
by: Che, Chang, et al.
Published: (2025)

TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
by: Jeon, Jeimin, et al.
Published: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

TC-LoRA: Temporally Modulated Conditional LoRA for Adaptive Diffusion Control
by: Cho, Minkyoung, et al.
Published: (2025)

AR-RAG: Autoregressive Retrieval Augmentation for Image Generation
by: Qi, Jingyuan, et al.
Published: (2025)

LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
by: Gao, Chenjian, et al.
Published: (2025)

Vision as LoRA
by: Wang, Han, et al.
Published: (2025)

LoRA of Change: Learning to Generate LoRA for the Editing Instruction from A Single Before-After Image Pair
by: Song, Xue, et al.
Published: (2024)

NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
by: Chen, Chuheng, et al.
Published: (2025)

MOLM: Mixture of LoRA Markers
by: Fares, Samar, et al.
Published: (2025)

Modality-Specialized Synergizers for Interleaved Vision-Language Generalists
by: Xu, Zhiyang, et al.
Published: (2024)

Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA
by: Wu, Zexi, et al.
Published: (2026)

In-Context LoRA for Diffusion Transformers
by: Huang, Lianghua, et al.
Published: (2024)

LoRA-Edge: Tensor-Train-Assisted LoRA for Practical CNN Fine-Tuning on Edge Devices
by: Kwak, Hyunseok, et al.
Published: (2025)

LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion
by: Zhang, Yisu, et al.
Published: (2025)

Meta-LoRA: Meta-Learning LoRA Components for Domain-Aware ID Personalization
by: Topal, Barış Batuhan, et al.
Published: (2025)

CA-LoRA: Concept-Aware LoRA for Domain-Aligned Segmentation Dataset Generation
by: Park, Minho, et al.
Published: (2025)

Deep LoRA-Unfolding Networks for Image Restoration
by: Wang, Xiangming, et al.
Published: (2026)

LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMs
by: Chen, Shaoxiang, et al.
Published: (2024)

MLAE: Masked LoRA Experts for Visual Parameter-Efficient Fine-Tuning
by: Wang, Junjie, et al.
Published: (2024)

TimeStep Master: Asymmetrical Mixture of Timestep LoRA Experts for Versatile and Efficient Diffusion Models in Vision
by: Zhuang, Shaobin, et al.
Published: (2025)

PILoRA: Prototype Guided Incremental LoRA for Federated Class-Incremental Learning
by: Guo, Haiyang, et al.
Published: (2024)

LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models
by: Liang, Jian, et al.
Published: (2025)

Multi-Modality Driven LoRA for Adverse Condition Depth Estimation
by: Yang, Guanglei, et al.
Published: (2024)

ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets
by: Kim, Hoyoung, et al.
Published: (2026)

Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning
by: Jia, Ziqi, et al.
Published: (2025)

SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Models
by: Zhang, Yue, et al.
Published: (2024)

ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
by: Dahan, Aviad, et al.
Published: (2026)

LangVision-LoRA-NAS: Neural Architecture Search for Variable LoRA Rank in Vision Language Models
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)

Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts
by: Zhu, Chenyang, et al.
Published: (2024)

MILE: Mixture of Incremental LoRA Experts for Continual Semantic Segmentation across Domains and Modalities
by: Muralidhara, Shishir, et al.
Published: (2026)

Deep Generative Continual Learning using Functional LoRA: FunLoRA
by: Enescu, Victor, et al.
Published: (2025)

FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalization
by: Zheng, Peng, et al.
Published: (2025)

LoRAtorio: An intrinsic approach to LoRA Skill Composition
by: Foteinopoulou, Niki, et al.
Published: (2025)

Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation
by: Li, Likun, et al.
Published: (2024)

K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAs
by: Ouyang, Ziheng, et al.
Published: (2025)

Bilevel Layer-Positioning LoRA for Real Image Dehazing
by: Zhang, Yan, et al.
Published: (2026)