Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout
Fuente:
arXiv
Saved in:
| Main Authors: | Zhang, Andi, Ding, Xuan, Wang, Haofan, McDonagh, Steven, Kaski, Samuel |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Concept-based Adversarial Attack: a Probabilistic Perspective
by: Zhang, Andi, et al.
Published: (2025)
by: Zhang, Andi, et al.
Published: (2025)
Decouple and Orthogonalize: A Data-Free Framework for LoRA Merging
by: Zheng, Shenghe, et al.
Published: (2025)
by: Zheng, Shenghe, et al.
Published: (2025)
ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
by: Liu, Yuehao, et al.
Published: (2026)
by: Liu, Yuehao, et al.
Published: (2026)
Ortho-Hydra: Orthogonalized Experts for DiT LoRA
by: Ji, Seunghyun
Published: (2026)
by: Ji, Seunghyun
Published: (2026)
Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks
by: Fang, Weibai, et al.
Published: (2026)
by: Fang, Weibai, et al.
Published: (2026)
DevFD: Developmental Face Forgery Detection by Learning Shared and Orthogonal LoRA Subspaces
by: Zhang, Tianshuo, et al.
Published: (2025)
by: Zhang, Tianshuo, et al.
Published: (2025)
SLAD : Shared LoRA Adapters for Task Specific Distillation
by: Bensaid, Reda, et al.
Published: (2026)
by: Bensaid, Reda, et al.
Published: (2026)
When LoRA Betrays: Backdooring Text-to-Image Models by Masquerading as Benign Adapters
by: Lyu, Liangwei, et al.
Published: (2026)
by: Lyu, Liangwei, et al.
Published: (2026)
LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion
by: Zhang, Yisu, et al.
Published: (2025)
by: Zhang, Yisu, et al.
Published: (2025)
DragLoRA: Online Optimization of LoRA Adapters for Drag-based Image Editing in Diffusion Model
by: Xia, Siwei, et al.
Published: (2025)
by: Xia, Siwei, et al.
Published: (2025)
TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
by: Jeon, Jeimin, et al.
Published: (2026)
by: Jeon, Jeimin, et al.
Published: (2026)
TC-LoRA: Temporally Modulated Conditional LoRA for Adaptive Diffusion Control
by: Cho, Minkyoung, et al.
Published: (2025)
by: Cho, Minkyoung, et al.
Published: (2025)
NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
by: Chen, Chuheng, et al.
Published: (2025)
by: Chen, Chuheng, et al.
Published: (2025)
Improving Object Detection via Local-global Contrastive Learning
by: Triantafyllidou, Danai, et al.
Published: (2024)
by: Triantafyllidou, Danai, et al.
Published: (2024)
Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion
by: Xu, Xuan, et al.
Published: (2026)
by: Xu, Xuan, et al.
Published: (2026)
LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
by: Gao, Chenjian, et al.
Published: (2025)
by: Gao, Chenjian, et al.
Published: (2025)
Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
by: Stogiannidis, Ilias, et al.
Published: (2025)
by: Stogiannidis, Ilias, et al.
Published: (2025)
DyME: Dynamic Multi-Concept Erasure in Diffusion Models with Bi-Level Orthogonal LoRA Adaptation
by: Liu, Jiaqi, et al.
Published: (2025)
by: Liu, Jiaqi, et al.
Published: (2025)
Evolutionary Negative Module Pruning for Better LoRA Merging
by: Cao, Anda, et al.
Published: (2026)
by: Cao, Anda, et al.
Published: (2026)
Meta-LoRA: Meta-Learning LoRA Components for Domain-Aware ID Personalization
by: Topal, Barış Batuhan, et al.
Published: (2025)
by: Topal, Barış Batuhan, et al.
Published: (2025)
CA-LoRA: Concept-Aware LoRA for Domain-Aligned Segmentation Dataset Generation
by: Park, Minho, et al.
Published: (2025)
by: Park, Minho, et al.
Published: (2025)
Vision as LoRA
by: Wang, Han, et al.
Published: (2025)
by: Wang, Han, et al.
Published: (2025)
LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
by: Ahn, Beomjin, et al.
Published: (2026)
by: Ahn, Beomjin, et al.
Published: (2026)
ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs
by: Shah, Viraj, et al.
Published: (2023)
by: Shah, Viraj, et al.
Published: (2023)
GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splatting
by: Agarwal, Madhav, et al.
Published: (2025)
by: Agarwal, Madhav, et al.
Published: (2025)
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)
by: Bian, Jieming, et al.
Published: (2024)
ID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
by: Dahan, Aviad, et al.
Published: (2026)
by: Dahan, Aviad, et al.
Published: (2026)
ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets
by: Kim, Hoyoung, et al.
Published: (2026)
by: Kim, Hoyoung, et al.
Published: (2026)
Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA
by: Wu, Zexi, et al.
Published: (2026)
by: Wu, Zexi, et al.
Published: (2026)
LangVision-LoRA-NAS: Neural Architecture Search for Variable LoRA Rank in Vision Language Models
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)
Label-Efficient Object Detection via Region Proposal Network Pre-Training
by: Dong, Nanqing, et al.
Published: (2022)
by: Dong, Nanqing, et al.
Published: (2022)
In-Context LoRA for Diffusion Transformers
by: Huang, Lianghua, et al.
Published: (2024)
by: Huang, Lianghua, et al.
Published: (2024)
Deep Generative Continual Learning using Functional LoRA: FunLoRA
by: Enescu, Victor, et al.
Published: (2025)
by: Enescu, Victor, et al.
Published: (2025)
Label-Free Cross-Task LoRA Merging with Null-Space Compression
by: Lee, Wonyoung, et al.
Published: (2026)
by: Lee, Wonyoung, et al.
Published: (2026)
LoRAtorio: An intrinsic approach to LoRA Skill Composition
by: Foteinopoulou, Niki, et al.
Published: (2025)
by: Foteinopoulou, Niki, et al.
Published: (2025)
LoRA of Change: Learning to Generate LoRA for the Editing Instruction from A Single Before-After Image Pair
by: Song, Xue, et al.
Published: (2024)
by: Song, Xue, et al.
Published: (2024)
LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
by: Che, Chang, et al.
Published: (2025)
by: Che, Chang, et al.
Published: (2025)
K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAs
by: Ouyang, Ziheng, et al.
Published: (2025)
by: Ouyang, Ziheng, et al.
Published: (2025)
ConsisLoRA: Enhancing Content and Style Consistency for LoRA-based Style Transfer
by: Chen, Bolin, et al.
Published: (2025)
by: Chen, Bolin, et al.
Published: (2025)
OP-LoRA: The Blessing of Dimensionality
by: Teterwak, Piotr, et al.
Published: (2024)
by: Teterwak, Piotr, et al.
Published: (2024)
Similar Items
-
Concept-based Adversarial Attack: a Probabilistic Perspective
by: Zhang, Andi, et al.
Published: (2025) -
Decouple and Orthogonalize: A Data-Free Framework for LoRA Merging
by: Zheng, Shenghe, et al.
Published: (2025) -
ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
by: Liu, Yuehao, et al.
Published: (2026) -
Ortho-Hydra: Orthogonalized Experts for DiT LoRA
by: Ji, Seunghyun
Published: (2026) -
Normality-Preserving Continual Industrial Anomaly Detection via Orthogonal LoRA Banks
by: Fang, Weibai, et al.
Published: (2026)