Cover Image

When Is Rank-1 Enough? Geometry-Guided Initialization for Parameter-Efficient Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Haoran, Han, Soyeon Caren, Hovy, Eduard
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Deep Learning based Visually Rich Document Content Understanding: A Survey
by: Ding, Yihao, et al.
Published: (2024)

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
by: Zhang, Mingyang, et al.
Published: (2023)

Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
by: Zhang, Xinxi, et al.
Published: (2024)

SAM-PTx: Text-Guided Fine-Tuning of SAM with Parameter-Efficient, Parallel-Text Adapters
by: Jalilian, Shayan, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning of DINOv2 for Large-Scale Font Classification
by: Chen, Daniel, et al.
Published: (2026)

GD-FPS: Growth-Driven Feedforward Parameter Selection for Efficient Fine-Tuning
by: Yang, Kenneth, et al.
Published: (2025)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
by: Sun, Guangyu, et al.
Published: (2022)

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
by: Xin, Yi, et al.
Published: (2024)

Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
by: Ly, Son Thai, et al.
Published: (2024)

Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuning
by: Sehanobish, Arijit, et al.
Published: (2024)

Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning
by: Si, Chongjie, et al.
Published: (2024)

Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning
by: Ren, Li, et al.
Published: (2024)

Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
by: Tang, Yiwen, et al.
Published: (2023)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

LoFT: Parameter-Efficient Fine-Tuning for Long-tailed Semi-Supervised Learning in Open-World Scenarios
by: Huang, Zhiyuan, et al.
Published: (2025)

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
by: Pan, Bin, et al.
Published: (2025)

Pix2Fact: When Vision Is Not Enough -- Benchmarking Fine-Grained VQA with Web Verification on High-Resolution Real-World Scenes
by: Jiang, Yifan, et al.
Published: (2026)

MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba
by: Yoshimura, Masakazu, et al.
Published: (2024)

Parameter Efficient Continual Learning with Dynamic Low-Rank Adaptation
by: Bhat, Prashant Shivaram, et al.
Published: (2025)

Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models
by: Shen, Shufan, et al.
Published: (2025)

Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning
by: Lee, Yeoreum, et al.
Published: (2025)

Advancing Compositional Awareness in CLIP with Efficient Fine-Tuning
by: Peleg, Amit, et al.
Published: (2025)

SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
by: Zhao, Linglan, et al.
Published: (2024)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
by: Shi, Zhengxiang, et al.
Published: (2023)

CLoRA: Parameter-Efficient Continual Learning with Low-Rank Adaptation
by: Muralidhara, Shishir, et al.
Published: (2025)

AdapterTune: Zero-Initialized Low-Rank Adapters for Frozen Vision Transformers
by: Khazem, Salim
Published: (2026)

Tuning Just Enough: Lightweight Backdoor Attacks on Multi-Encoder Diffusion Models
by: Chen, Ziyuan, et al.
Published: (2026)

Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models
by: Shirkavand, Reza, et al.
Published: (2024)

Efficient and Versatile Robust Fine-Tuning of Zero-shot Models
by: Kim, Sungyeon, et al.
Published: (2024)

Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
by: Jie, Shibo, et al.
Published: (2024)

Lightweight Modular Parameter-Efficient Tuning for Open-Vocabulary Object Detection
by: Faye, Bilal, et al.
Published: (2024)

Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer
by: Nagamori, Teru, et al.
Published: (2024)

Gradient Inversion Attacks on Parameter-Efficient Fine-Tuning
by: Sami, Hasin Us, et al.
Published: (2025)

When Accuracy Is Not Enough: Uncertainty Collapse between Noisy Label Learning and Out-of-Distribution Detection
by: Peng, Ningkang, et al.
Published: (2026)

Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognition
by: Mai, Zheda, et al.
Published: (2024)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
by: Chang, Huandong, et al.
Published: (2025)

VARD: Efficient and Dense Fine-Tuning for Diffusion Models with Value-based RL
by: Dai, Fengyuan, et al.
Published: (2025)

Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product
by: Albert, Paul, et al.
Published: (2025)

On the Robustness Tradeoff in Fine-Tuning
by: Li, Kunyang, et al.
Published: (2025)

Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification
by: Li, Ming, et al.
Published: (2024)