Cover Image

Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dong, Wei, Zhang, Xing, Chen, Bihui, Yan, Dawei, Lin, Zhijun, Yan, Qingsen, Wang, Peng, Yang, Yang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
by: Dong, Wei, et al.
Published: (2024)

Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing
by: Dong, Wei, et al.
Published: (2023)

Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy
by: Yang, Yiting, et al.
Published: (2025)

Invertible Residual Rescaling Models
by: Li, Jinmin, et al.
Published: (2024)

TRIO: Token Reduction via Inference-Objective Guidance for Efficient Vision-Language Models
by: Zhang, Haokui, et al.
Published: (2026)

Effective Fine-Tuning of Vision Transformers with Low-Rank Adaptation for Privacy-Preserving Image Classification
by: Lin, Haiwei, et al.
Published: (2025)

LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning
by: Shi, Yiming, et al.
Published: (2024)

Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design
by: Dong, Wei, et al.
Published: (2025)

Bracketing Image Restoration and Enhancement with High-Low Frequency Decomposition
by: Chen, Genggeng, et al.
Published: (2024)

Lossless Token Merging Even Without Fine-Tuning in Vision Transformers
by: Lee, Jaeyeon, et al.
Published: (2025)

Introducing Routing Functions to Vision-Language Parameter-Efficient Fine-Tuning with Low-Rank Bottlenecks
by: Qu, Tingyu, et al.
Published: (2024)

TG-LLaVA: Text Guided LLaVA via Learnable Latent Embeddings
by: Yan, Dawei, et al.
Published: (2024)

PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
by: Wang, Yijian, et al.
Published: (2026)

SAC-ViT: Semantic-Aware Clustering Vision Transformer with Early Exit
by: Hu, Youbing, et al.
Published: (2025)

Hierarchical Side-Tuning for Vision Transformers
by: Lin, Weifeng, et al.
Published: (2023)

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
by: Zhang, Mingyang, et al.
Published: (2023)

HVI-CIDNet+: Beyond Extreme Darkness for Low-Light Image Enhancement
by: Yan, Qingsen, et al.
Published: (2025)

You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement
by: Yan, Qingsen, et al.
Published: (2024)

GMODiff: One-Step Gain Map Refinement with Diffusion Priors for HDR Reconstruction
by: Hu, Tao, et al.
Published: (2025)

Sparse Fine-Tuning of Transformers for Generative Tasks
by: Chen, Wei, et al.
Published: (2025)

Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation
by: Bafghi, Reza Akbarian, et al.
Published: (2025)

FQ-PETR: Fully Quantized Position Embedding Transformation for Multi-View 3D Object Detection
by: Yu, Jiangyong, et al.
Published: (2025)

Towards Video Anomaly Detection from Event Streams: A Baseline and Benchmark Datasets
by: Wu, Peng, et al.
Published: (2026)

Faithful Extreme Image Rescaling with Learnable Reversible Transformation and Semantic Priors
by: Wei, Hao, et al.
Published: (2026)

Collaborative Low-Rank Adaptation for Pre-Trained Vision Transformers
by: Liu, Zheng, et al.
Published: (2025)

SALT: Parameter-Efficient Fine-Tuning via Singular Value Adaptation with Low-Rank Transformation
by: Elsayed, Abdelrahman, et al.
Published: (2025)

AdapterTune: Zero-Initialized Low-Rank Adapters for Frozen Vision Transformers
by: Khazem, Salim
Published: (2026)

FusionNet: Multi-model Linear Fusion Framework for Low-light Image Enhancement
by: Shi, Kangbiao, et al.
Published: (2025)

Sparse-Tuning: Adapting Vision Transformers with Efficient Fine-tuning and Inference
by: Liu, Ting, et al.
Published: (2024)

Boosting HDR Image Reconstruction via Semantic Knowledge Transfer
by: Hu, Tao, et al.
Published: (2025)

TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restoration
by: Tu, Yanjie, et al.
Published: (2026)

Generating Content for HDR Deghosting from Frequency View
by: Hu, Tao, et al.
Published: (2024)

LF-ViT: Reducing Spatial Redundancy in Vision Transformer for Efficient Image Recognition
by: Hu, Youbing, et al.
Published: (2024)

Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision
by: Li, Minglei, et al.
Published: (2024)

Data-Efficient Fine-Tuning of Vision-Language Models for Diagnosis of Alzheimer's Disease
by: Cheng, Fangqi, et al.
Published: (2025)

Vision Mamba Distillation for Low-resolution Fine-grained Image Classification
by: Chen, Yao, et al.
Published: (2024)

Hyperspectral Super-Resolution with Inter-Image Variability via Degradation-based Low-Rank and Residual Fusion Method
by: Wen, Yue, et al.
Published: (2025)

Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Prompts
by: Wu, Peng, et al.
Published: (2024)

LPViT: Low-Power Semi-structured Pruning for Vision Transformers
by: Xu, Kaixin, et al.
Published: (2024)

Dynamic Embedding of Hierarchical Visual Features for Efficient Vision-Language Fine-Tuning
by: Wei, Xinyu, et al.
Published: (2025)