Cover Image

Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Yiting, Luo, Hao, Sun, Yuan, Yan, Qingsen, Zhang, Haokui, Dong, Wei, Wang, Guoqing, Wang, Peng, Yang, Yang, Shen, Hengtao
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
by: Dong, Wei, et al.
Published: (2024)

Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
by: Dong, Wei, et al.
Published: (2024)

Split Adaptation for Pre-trained Vision Transformers
by: Wang, Lixu, et al.
Published: (2025)

Diffusion Models as Optimizers for Efficient Planning in Offline RL
by: Huang, Renming, et al.
Published: (2024)

Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation
by: Wu, Fei, et al.
Published: (2025)

UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
by: Zhang, Xueyan, et al.
Published: (2025)

TRIO: Token Reduction via Inference-Objective Guidance for Efficient Vision-Language Models
by: Zhang, Haokui, et al.
Published: (2026)

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation
by: Liu, Jun, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
by: Xin, Yi, et al.
Published: (2024)

An Empirical Study of Parameter Efficient Fine-tuning on Vision-Language Pre-train Model
by: Tian, Yuxin, et al.
Published: (2024)

Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
by: Tang, Yiwen, et al.
Published: (2023)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
by: Ma, Xinyu, et al.
Published: (2024)

Pre-trained Transformer-Enabled Strategies with Human-Guided Fine-Tuning for End-to-end Navigation of Autonomous Vehicles
by: Hu, Dong, et al.
Published: (2024)

Goal-Reaching Policy Learning from Non-Expert Observations via Effective Subgoal Guidance
by: Huang, RenMing, et al.
Published: (2024)

Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer
by: Nagamori, Teru, et al.
Published: (2024)

TG-LLaVA: Text Guided LLaVA via Learnable Latent Embeddings
by: Yan, Dawei, et al.
Published: (2024)

EA-ViT: Efficient Adaptation for Elastic Vision Transformer
by: Zhu, Chen, et al.
Published: (2025)

NEARL-CLIP: Interacted Query Adaptation with Orthogonal Regularization for Medical Vision-Language Understanding
by: Peng, Zelin, et al.
Published: (2025)

Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models
by: Yang, Fan, et al.
Published: (2024)

Pre-trained Model Guided Fine-Tuning for Zero-Shot Adversarial Robustness
by: Wang, Sibo, et al.
Published: (2024)

Efficient Online RL Fine Tuning with Offline Pre-trained Policy Only
by: Xiao, Wei, et al.
Published: (2025)

Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
by: Liang, Yao, et al.
Published: (2024)

New Dataset and Methods for Fine-Grained Compositional Referring Expression Comprehension via Specialist-MLLM Collaboration
by: Yang, Xuzheng, et al.
Published: (2025)

ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Models
by: Ye, Wencheng, et al.
Published: (2025)

Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training
by: Lei, Xingliang, et al.
Published: (2024)

Generative Pre-trained Autoregressive Diffusion Transformer
by: Zhang, Yuan, et al.
Published: (2025)

Generalized Tensor-based Parameter-Efficient Fine-Tuning via Lie Group Transformations
by: Si, Chongjie, et al.
Published: (2025)

Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
by: Ly, Son Thai, et al.
Published: (2024)

FashionFAE: Fine-grained Attributes Enhanced Fashion Vision-Language Pre-training
by: Huang, Jiale, et al.
Published: (2024)

Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing
by: Dong, Wei, et al.
Published: (2023)

Parameter-Efficient Fine-Tuning With Adapters
by: Chen, Keyu, et al.
Published: (2024)

Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion Forecasting Models
by: Wang, Jifeng, et al.
Published: (2024)

Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding
by: Li, Da, et al.
Published: (2025)

CERSA: Cumulative Energy-Retaining Subspace Adaptation for Memory-Efficient Fine-Tuning
by: Ge, Jingze, et al.
Published: (2026)

Artifacts and Attention Sinks: Structured Approximations for Efficient Vision Transformers
by: Lu, Andrew, et al.
Published: (2025)

Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
by: Li, Qiang, et al.
Published: (2025)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves
by: Wu, Shihan, et al.
Published: (2024)

Transformers as Game Players: Provable In-context Game-playing Capabilities of Pre-trained Models
by: Shi, Chengshuai, et al.
Published: (2024)

VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicine
by: Zhang, Ziyang, et al.
Published: (2025)

Accurate Measles Rash Detection via Vision Transformer Fine-Tuning
by: Rajakaruna, Harshana, et al.
Published: (2020)