Cover Image

Decouple and Orthogonalize: A Data-Free Framework for LoRA Merging

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Shenghe, Wang, Hongzhi, Huang, Chenyu, Wang, Xiaohui, Chen, Tao, Fan, Jiayuan, Hu, Shuyue, Ye, Peng
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FREE-Switch: Frequency-based Dynamic LoRA Switch for Style Transfer
by: Zheng, Shenghe, et al.
Published: (2026)

FREE-Merging: Fourier Transform for Efficient Model Merging
by: Zheng, Shenghe, et al.
Published: (2024)

FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalization
by: Zheng, Peng, et al.
Published: (2025)

ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
by: Liu, Yuehao, et al.
Published: (2026)

Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout
by: Zhang, Andi, et al.
Published: (2025)

Breaking the Compression Ceiling: Data-Free Pipeline for Ultra-Efficient Delta Compression
by: Wang, Xiaohui, et al.
Published: (2025)

Vision as LoRA
by: Wang, Han, et al.
Published: (2025)

Seeing Delta Parameters as JPEG Images: Data-Free Delta Compression with Discrete Cosine Transform
by: Huang, Chenyu, et al.
Published: (2025)

Evolutionary Negative Module Pruning for Better LoRA Merging
by: Cao, Anda, et al.
Published: (2026)

FRISM: Fine-Grained Reasoning Injection via Subspace-Level Model Merging for Vision-Language Models
by: Huang, Chenyu, et al.
Published: (2026)

Dynamic Base model Shift for Delta Compression
by: Huang, Chenyu, et al.
Published: (2025)

Exploring Data-Free LoRA Transferability for Video Diffusion Models
by: Wang, Yuchen, et al.
Published: (2026)

In-Context LoRA for Diffusion Transformers
by: Huang, Lianghua, et al.
Published: (2024)

Label-Free Cross-Task LoRA Merging with Null-Space Compression
by: Lee, Wonyoung, et al.
Published: (2026)

NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
by: Chen, Chuheng, et al.
Published: (2025)

StolenLoRA: Exploring LoRA Extraction Attacks via Synthetic Data
by: Wang, Yixu, et al.
Published: (2025)

Ortho-Hydra: Orthogonalized Experts for DiT LoRA
by: Ji, Seunghyun
Published: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

DevFD: Developmental Face Forgery Detection by Learning Shared and Orthogonal LoRA Subspaces
by: Zhang, Tianshuo, et al.
Published: (2025)

In-Context Meta LoRA Generation
by: Shao, Yihua, et al.
Published: (2025)

TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
by: Jeon, Jeimin, et al.
Published: (2026)

LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
by: Gao, Chenjian, et al.
Published: (2025)

K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAs
by: Ouyang, Ziheng, et al.
Published: (2025)

EMR-Merging: Tuning-Free High-Performance Model Merging
by: Huang, Chenyu, et al.
Published: (2024)

LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
by: Che, Chang, et al.
Published: (2025)

TC-LoRA: Temporally Modulated Conditional LoRA for Adaptive Diffusion Control
by: Cho, Minkyoung, et al.
Published: (2025)

One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Control
by: Mi, Zhenxing, et al.
Published: (2025)

ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs
by: Shah, Viraj, et al.
Published: (2023)

TARA: Token-Aware LoRA for Composable Personalization in Diffusion Models
by: Peng, Yuqi, et al.
Published: (2025)

Multimodal Instruction Tuning with Conditional Mixture of LoRA
by: Shen, Ying, et al.
Published: (2024)

Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks
by: Fang, Weibai, et al.
Published: (2026)

Meta-LoRA: Meta-Learning LoRA Components for Domain-Aware ID Personalization
by: Topal, Barış Batuhan, et al.
Published: (2025)

CA-LoRA: Concept-Aware LoRA for Domain-Aligned Segmentation Dataset Generation
by: Park, Minho, et al.
Published: (2025)

Bilevel Layer-Positioning LoRA for Real Image Dehazing
by: Zhang, Yan, et al.
Published: (2026)

Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA
by: Wu, Zexi, et al.
Published: (2026)

ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
by: Dahan, Aviad, et al.
Published: (2026)

Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
by: Ge, Chendi, et al.
Published: (2025)

LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion
by: Zhang, Yisu, et al.
Published: (2025)

LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models
by: Liang, Jian, et al.
Published: (2025)

ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets
by: Kim, Hoyoung, et al.
Published: (2026)