Beyond Low-Rank Tuning: Model Prior-Guided Rank Allocation for Effective Transfer in Low-Data and Large-Gap Regimes
Fuente:
arXiv
Saved in:
| Main Authors: | Zhang, Chuyan, Wang, Kefan, Gu, Yun |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization
by: Zhao, Yumiao, et al.
Published: (2026)
by: Zhao, Yumiao, et al.
Published: (2026)
Compact Model Training by Low-Rank Projection with Energy Transfer
by: Guo, Kailing, et al.
Published: (2022)
by: Guo, Kailing, et al.
Published: (2022)
Large Vision Model-Guided Masked Low-Rank Approximation for Ground-Roll Attenuation
by: Liao, Jiacheng, et al.
Published: (2026)
by: Liao, Jiacheng, et al.
Published: (2026)
Low-Rank Knowledge Decomposition for Medical Foundation Models
by: Zhou, Yuhang, et al.
Published: (2024)
by: Zhou, Yuhang, et al.
Published: (2024)
Task-Aware Low-Rank Adaptation of Segment Anything Model
by: Wang, Xuehao, et al.
Published: (2024)
by: Wang, Xuehao, et al.
Published: (2024)
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
by: Dong, Wei, et al.
Published: (2024)
by: Dong, Wei, et al.
Published: (2024)
Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation
by: Bafghi, Reza Akbarian, et al.
Published: (2025)
by: Bafghi, Reza Akbarian, et al.
Published: (2025)
Data-Adaptive Transformed Bilateral Tensor Low-Rank Representation for Clustering
by: Chen, Hui, et al.
Published: (2025)
by: Chen, Hui, et al.
Published: (2025)
SLoRD: Structural Low-Rank Descriptors for Shape Consistency in Vertebrae Segmentation
by: You, Xin, et al.
Published: (2024)
by: You, Xin, et al.
Published: (2024)
A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis
by: Yin, Yi, et al.
Published: (2025)
by: Yin, Yi, et al.
Published: (2025)
LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models
by: Li, Haolin, et al.
Published: (2024)
by: Li, Haolin, et al.
Published: (2024)
Superpixel-informed Continuous Low-Rank Tensor Representation for Multi-Dimensional Data Recovery
by: Wang, Zhizhou, et al.
Published: (2025)
by: Wang, Zhizhou, et al.
Published: (2025)
Low-Rank Few-Shot Adaptation of Vision-Language Models
by: Zanella, Maxime, et al.
Published: (2024)
by: Zanella, Maxime, et al.
Published: (2024)
Low-Rank Head Avatar Personalization with Registers
by: Chakkera, Sai Tanmay Reddy, et al.
Published: (2025)
by: Chakkera, Sai Tanmay Reddy, et al.
Published: (2025)
Low-Rank Interconnected Adaptation across Layers
by: Zhong, Yibo, et al.
Published: (2024)
by: Zhong, Yibo, et al.
Published: (2024)
Breaking the Low-Rank Dilemma of Linear Attention
by: Fan, Qihang, et al.
Published: (2024)
by: Fan, Qihang, et al.
Published: (2024)
FouRA: Fourier Low Rank Adaptation
by: Borse, Shubhankar, et al.
Published: (2024)
by: Borse, Shubhankar, et al.
Published: (2024)
Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts
by: Chen, Qizhou, et al.
Published: (2024)
by: Chen, Qizhou, et al.
Published: (2024)
Introducing Routing Functions to Vision-Language Parameter-Efficient Fine-Tuning with Low-Rank Bottlenecks
by: Qu, Tingyu, et al.
Published: (2024)
by: Qu, Tingyu, et al.
Published: (2024)
Erase to Retain: Low Rank Adaptation Guided Selective Unlearning in Medical Segmentation Networks
by: Datta, Nirjhor, et al.
Published: (2025)
by: Datta, Nirjhor, et al.
Published: (2025)
Effective Fine-Tuning of Vision Transformers with Low-Rank Adaptation for Privacy-Preserving Image Classification
by: Lin, Haiwei, et al.
Published: (2025)
by: Lin, Haiwei, et al.
Published: (2025)
Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation
by: Xiao, Xi, et al.
Published: (2026)
by: Xiao, Xi, et al.
Published: (2026)
WSVD: Weighted Low-Rank Approximation for Fast and Efficient Execution of Low-Precision Vision-Language Models
by: Wang, Haiyu, et al.
Published: (2026)
by: Wang, Haiyu, et al.
Published: (2026)
Beyond CNNs: Efficient Fine-Tuning of Multi-Modal LLMs for Object Detection on Low-Data Regimes
by: Elamon, Nirmal, et al.
Published: (2025)
by: Elamon, Nirmal, et al.
Published: (2025)
Integrating Frequency-Domain Representations with Low-Rank Adaptation in Vision-Language Models
by: Khan, Md Azim, et al.
Published: (2025)
by: Khan, Md Azim, et al.
Published: (2025)
Low-Rank Adaptation of Geospatial Foundation Models for Wildfire Mapping Using Sentinel-2 Data
by: Shibli, Ali, et al.
Published: (2026)
by: Shibli, Ali, et al.
Published: (2026)
LARGO: Low-Rank Regulated Gradient Projection for Robust Parameter Efficient Fine-Tuning
by: Zhang, Haotian, et al.
Published: (2025)
by: Zhang, Haotian, et al.
Published: (2025)
Low-Rank Adaptive Structural Priors for Generalizable Diabetic Retinopathy Grading
by: Wang, Yunxuan, et al.
Published: (2025)
by: Wang, Yunxuan, et al.
Published: (2025)
Modular Customization of Diffusion Models via Blockwise-Parameterized Low-Rank Adaptation
by: Zhu, Mingkang, et al.
Published: (2025)
by: Zhu, Mingkang, et al.
Published: (2025)
LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
by: Zhang, Mingyang, et al.
Published: (2023)
by: Zhang, Mingyang, et al.
Published: (2023)
Null-LoRA: Low-Rank Adaptation on Null Space
by: Zhang, Yi, et al.
Published: (2025)
by: Zhang, Yi, et al.
Published: (2025)
Diffusion Low Rank Hybrid Reconstruction for Sparse View Medical Imaging
by: Deng, Zongyin, et al.
Published: (2025)
by: Deng, Zongyin, et al.
Published: (2025)
DoRA: Weight-Decomposed Low-Rank Adaptation
by: Liu, Shih-Yang, et al.
Published: (2024)
by: Liu, Shih-Yang, et al.
Published: (2024)
A Low-Rank Defense Method for Adversarial Attack on Diffusion Models
by: Zhu, Jiaxuan, et al.
Published: (2026)
by: Zhu, Jiaxuan, et al.
Published: (2026)
Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation
by: Chen, Qian, et al.
Published: (2024)
by: Chen, Qian, et al.
Published: (2024)
MokA: Multimodal Low-Rank Adaptation for MLLMs
by: Wei, Yake, et al.
Published: (2025)
by: Wei, Yake, et al.
Published: (2025)
Group Orthogonal Low-Rank Adaptation for RGB-T Tracking
by: Shao, Zekai, et al.
Published: (2025)
by: Shao, Zekai, et al.
Published: (2025)
Video Unlearning via Low-Rank Refusal Vector
by: Facchiano, Simone, et al.
Published: (2025)
by: Facchiano, Simone, et al.
Published: (2025)
LARGO: Low-Rank Hypernetwork for Handling Missing Modalities
by: Vyncke, Niels, et al.
Published: (2026)
by: Vyncke, Niels, et al.
Published: (2026)
LoRA-TTT: Low-Rank Test-Time Training for Vision-Language Models
by: Kojima, Yuto, et al.
Published: (2025)
by: Kojima, Yuto, et al.
Published: (2025)
Similar Items
-
Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization
by: Zhao, Yumiao, et al.
Published: (2026) -
Compact Model Training by Low-Rank Projection with Energy Transfer
by: Guo, Kailing, et al.
Published: (2022) -
Large Vision Model-Guided Masked Low-Rank Approximation for Ground-Roll Attenuation
by: Liao, Jiacheng, et al.
Published: (2026) -
Low-Rank Knowledge Decomposition for Medical Foundation Models
by: Zhou, Yuhang, et al.
Published: (2024) -
Task-Aware Low-Rank Adaptation of Segment Anything Model
by: Wang, Xuehao, et al.
Published: (2024)