Cover Image

Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xiao, Xi, Ma, Chenrui, Zhang, Yunbei, Liu, Chen, Wang, Zhuxuanzi, Li, Yanshu, Zhao, Lin, Hu, Guosheng, Wang, Tianyang, Xu, Hao
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
by: Wang, Zhuxuanzi, et al.
Published: (2025)

Self-Supervised Visual Prompting for Cross-Domain Road Damage Detection
by: Xiao, Xi, et al.
Published: (2025)

CAD-VAE: Leveraging Correlation-Aware Latents for Comprehensive Fair Disentanglement
by: Ma, Chenrui, et al.
Published: (2025)

Beyond Editing Pairs: Fine-Grained Instructional Image Editing via Multi-Scale Learnable Regions
by: Ma, Chenrui, et al.
Published: (2025)

Learning Straight Flows: Variational Flow Matching for Efficient Generation
by: Ma, Chenrui, et al.
Published: (2025)

Stochastic Interpolants via Conditional Dependent Coupling
by: Ma, Chenrui, et al.
Published: (2025)

RoadBench: A Vision-Language Foundation Model and Benchmark for Road Damage Understanding
by: Xiao, Xi, et al.
Published: (2025)

Drift Flow Matching
by: Ma, Chenrui, et al.
Published: (2026)

Task-Aware Low-Rank Adaptation of Segment Anything Model
by: Wang, Xuehao, et al.
Published: (2024)

Prompt-based Adaptation in Large-scale Vision Models: A Survey
by: Xiao, Xi, et al.
Published: (2025)

Visual Instance-aware Prompt Tuning
by: Xiao, Xi, et al.
Published: (2025)

Visual Variational Autoencoder Prompt Tuning
by: Xiao, Xi, et al.
Published: (2025)

Efficient Knowledge Transfer in Multi-Task Learning through Task-Adaptive Low-Rank Representation
by: Zhang, Xiao, et al.
Published: (2025)

ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation
by: Liang, Jian, et al.
Published: (2025)

ALoRE: Efficient Visual Adaptation via Aggregating Low Rank Experts
by: Du, Sinan, et al.
Published: (2024)

GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learning
by: Yang, Zhe-Rui, et al.
Published: (2024)

MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
by: Wang, Xujia, et al.
Published: (2024)

M$^2$IV: Towards Efficient and Fine-grained Multimodal In-Context Learning via Representation Engineering
by: Li, Yanshu, et al.
Published: (2025)

GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR
by: Zhang, Jiaying, et al.
Published: (2026)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
by: Yang, Yaming, et al.
Published: (2024)

Mixture-of-Subspaces in Low-Rank Adaptation
by: Wu, Taiqiang, et al.
Published: (2024)

RaSA: Rank-Sharing Low-Rank Adaptation
by: He, Zhiwei, et al.
Published: (2025)

Describe Anything in Medical Images
by: Xiao, Xi, et al.
Published: (2025)

Channel-Aware Low-Rank Adaptation in Time Series Forecasting
by: Nie, Tong, et al.
Published: (2024)

From Physical Degradation Models to Task-Aware All-in-One Image Restoration
by: Gao, Hu, et al.
Published: (2026)

Advancing Multimodal In-Context Learning in Large Vision-Language Models with Task-aware Demonstrations
by: Li, Yanshu
Published: (2025)

Preventing Rank Collapse in Federated Low-Rank Adaptation with Client Heterogeneity
by: Wu, Fei, et al.
Published: (2026)

Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation
by: Zhu, Mingkang, et al.
Published: (2025)

An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
by: Balzano, Laura, et al.
Published: (2025)

The Primacy of Magnitude in Low-Rank Adaptation
by: Zhang, Zicheng, et al.
Published: (2025)

Scalable Multi-Task Low-Rank Model Adaptation
by: Tian, Zichen, et al.
Published: (2026)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
by: Lin, Weicheng, et al.
Published: (2026)

Towards Unified Multi-task EEG Analysis with Low-Rank Adaptation
by: Dai, Sicheng, et al.
Published: (2026)

Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptation
by: Wang, Janet, et al.
Published: (2023)

Data Efficient Adaptation in Large Language Models via Continuous Low-Rank Fine-Tuning
by: Han, Xiao, et al.
Published: (2025)

TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
by: Mu, Lin, et al.
Published: (2026)

Spectral-Aware Low-Rank Adaptation for Speaker Verification
by: Li, Zhe, et al.
Published: (2025)

Towards Federated Low-Rank Adaptation of Language Models with Rank Heterogeneity
by: Byun, Yuji, et al.
Published: (2024)

LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection
by: Zhao, Lanxin, et al.
Published: (2026)

Norm-Bounded Low-Rank Adaptation
by: Wang, Ruigang, et al.
Published: (2025)