Copertina

Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bafghi, Reza Akbarian, Harilal, Nidhin, Monteleoni, Claire, Raissi, Maziar
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MixDiff: Mixing Natural and Synthetic Images for Robust Self-Supervised Representations
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2024)

Where Did Your Model Learn That? Label-free Influence for Self-supervised Learning
di: Harilal, Nidhin, et al.
Pubblicazione: (2024)

Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2025)

Elastic ViTs from Pretrained Models without Retraining
di: Simoncini, Walter, et al.
Pubblicazione: (2025)

Purrturbed but Stable: Human-Cat Invariant Representations Across CNNs, ViTs and Self-Supervised ViTs
di: Shah, Arya, et al.
Pubblicazione: (2025)

I&S-ViT: An Inclusive & Stable Method for Pushing the Limit of Post-Training ViTs Quantization
di: Zhong, Yunshan, et al.
Pubblicazione: (2023)

Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey
di: Siméoni, Oriane, et al.
Pubblicazione: (2023)

U-REPA: Aligning Diffusion U-Nets to ViTs
di: Tian, Yuchuan, et al.
Pubblicazione: (2025)

Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferability
di: Liu, Jiani, et al.
Pubblicazione: (2025)

Pretrained ViTs Yield Versatile Representations For Medical Images
di: Matsoukas, Christos, et al.
Pubblicazione: (2023)

DFQ-ViT: Data-Free Quantization for Vision Transformers without Fine-tuning
di: Tong, Yujia, et al.
Pubblicazione: (2025)

STRAP-ViT: Segregated Tokens with Randomized -- Transformations for Defense against Adversarial Patches in ViTs
di: Chattopadhyay, Nandish, et al.
Pubblicazione: (2026)

Colinearity Decay: Training Quantization-Friendly ViTs with Outlier Decay
di: Tong, Jin, et al.
Pubblicazione: (2026)

Which Direction to Choose? An Analysis on the Representation Power of Self-Supervised ViTs in Downstream Tasks
di: Kaltampanidis, Yannis, et al.
Pubblicazione: (2025)

AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs
di: Zheng, Yunling, et al.
Pubblicazione: (2024)

From Centerlines to Hemodynamics: Anisotropic RBF Decoders for Coronary Arteries
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2026)

Intriguing Frequency Interpretation of Adversarial Robustness for CNNs and ViTs
di: Chen, Lu, et al.
Pubblicazione: (2025)

UniRefiner: Teaching Pre-trained ViTs to Self-Dispose Dross via Contrastive Register
di: Qiu, Congpei, et al.
Pubblicazione: (2026)

SAFE: a SAR Feature Extractor based on self-supervised learning and masked Siamese ViTs
di: Muzeau, Max, et al.
Pubblicazione: (2024)

CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs
di: Ramachandran, Akshat, et al.
Pubblicazione: (2024)

Token Cropr: Faster ViTs for Quite a Few Tasks
di: Bergner, Benjamin, et al.
Pubblicazione: (2024)

Communication Efficient Split Learning of ViTs with Attention-based Double Compression
di: Alvetreti, Federico, et al.
Pubblicazione: (2025)

Training-Free Acceleration of ViTs with Delayed Spatial Merging
di: Heo, Jung Hwan, et al.
Pubblicazione: (2023)

Octic Vision Transformers: Quicker ViTs Through Equivariance
di: Nordström, David, et al.
Pubblicazione: (2025)

EdgeCrafter: Compact ViTs for Edge Dense Prediction via Task-Specialized Distillation
di: Liu, Longfei, et al.
Pubblicazione: (2026)

Adapting Pretrained ViTs with Convolution Injector for Visuo-Motor Control
di: Hwang, Dongyoon, et al.
Pubblicazione: (2024)

QID: Efficient Query-Informed ViTs in Data-Scarce Regimes for OCR-free Visual Document Understanding
di: Le, Binh M., et al.
Pubblicazione: (2025)

VIVID-Med: LLM-Supervised Structured Pretraining for Deployable Medical ViTs
di: Wang, Xiyao, et al.
Pubblicazione: (2026)

CAIT: Triple-Win Compression towards High Accuracy, Fast Inference, and Favorable Transferability For ViTs
di: Wang, Ao, et al.
Pubblicazione: (2023)

ViTs for Action Classification in Videos: An Approach to Risky Tackle Detection in American Football Practice Videos
di: Zaidi, Syed Ahsan Masud, et al.
Pubblicazione: (2026)

Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness
di: Elisha, Yehonatan, et al.
Pubblicazione: (2026)

ConcatPlexer: Additional Dim1 Batching for Faster ViTs
di: Han, Donghoon, et al.
Pubblicazione: (2023)

ViTs are Everywhere: A Comprehensive Study Showcasing Vision Transformers in Different Domain
di: Mia, Md Sohag, et al.
Pubblicazione: (2023)

Exploring the Synergies of Hybrid CNNs and ViTs Architectures for Computer Vision: A survey
di: Yunusa, Haruna, et al.
Pubblicazione: (2024)

Causality $\neq$ Decodability, and Vice Versa: Lessons from Interpreting Counting ViTs
di: Huang, Lianghuan, et al.
Pubblicazione: (2025)

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs
di: Kim, Donghyun, et al.
Pubblicazione: (2024)

Implicit to Explicit Entropy Regularization: Benchmarking ViT Fine-tuning under Noisy Labels
di: Marrium, Maria, et al.
Pubblicazione: (2024)

SToRe3D: Sparse Token Relevance in ViTs for Efficient Multi-View 3D Object Detection
di: Papais, Sandro, et al.
Pubblicazione: (2026)

TAP-ViTs: Task-Adaptive Pruning for On-Device Deployment of Vision Transformers
di: Wang, Zhibo, et al.
Pubblicazione: (2026)

Register and [CLS] tokens yield a decoupling of local and global features in large ViTs
di: Lappe, Alexander, et al.
Pubblicazione: (2025)