Cover Image

Compact Vision Transformer by Reduction of Kernel Complexity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Yancheng, Yang, Yingzhen
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Visual Transformer by Learnable Token Merging
by: Wang, Yancheng, et al.
Published: (2024)

Learning Informative Attention Weights for Person Re-Identification
by: Wang, Yancheng, et al.
Published: (2025)

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
by: Nath, Utkarsh, et al.
Published: (2023)

Learning Low-Rank Feature for Thorax Disease Classification
by: Goel, Rajeev, et al.
Published: (2024)

Diversity-Guided MLP Reduction for Efficient Large Vision Transformers
by: Shen, Chengchao, et al.
Published: (2025)

Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models
by: Shen, Shufan, et al.
Published: (2025)

Stable Vision Concept Transformers for Medical Diagnosis
by: Hu, Lijie, et al.
Published: (2025)

Your Image is Secretly the Last Frame of a Pseudo Video
by: Chen, Wenlong, et al.
Published: (2024)

Parameter Reduction Improves Vision Transformers: A Comparative Study of Sharing and Width Reduction
by: Kumar, Anantha Padmanaban Krishna
Published: (2025)

Split Adaptation for Pre-trained Vision Transformers
by: Wang, Lixu, et al.
Published: (2025)

Data-independent Module-aware Pruning for Hierarchical Vision Transformers
by: He, Yang, et al.
Published: (2024)

Slicing Vision Transformer for Flexible Inference
by: Zhang, Yitian, et al.
Published: (2024)

Attention Transfer Is Not Universally Effective for Vision Transformers
by: Qin, Huaiyuan, et al.
Published: (2026)

Leveraging Registers in Vision Transformers for Robust Adaptation
by: Yellapragada, Srikar, et al.
Published: (2025)

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder
by: Liu, Yancheng, et al.
Published: (2026)

Kernel PCA for Out-of-Distribution Detection: Non-Linear Kernel Selections and Approximations
by: Fang, Kun, et al.
Published: (2025)

When Training-Free NAS Meets Vision Transformer: A Neural Tangent Kernel Perspective
by: Zhou, Qiqi, et al.
Published: (2024)

Native Segmentation Vision Transformers
by: Brasó, Guillem, et al.
Published: (2025)

Approximate Nullspace Augmented Finetuning for Robust Vision Transformers
by: Liu, Haoyang, et al.
Published: (2024)

Iwin Transformer: Hierarchical Vision Transformer using Interleaved Windows
by: Huo, Simin, et al.
Published: (2025)

Compact Twice Fusion Network for Edge Detection
by: Li, Yachuan, et al.
Published: (2023)

Decorrelation Speeds Up Vision Transformers
by: Carrigg, Kieran, et al.
Published: (2025)

RAViT: Resolution-Adaptive Vision Transformer
by: Guidez, Martial, et al.
Published: (2026)

Rotary Position Embedding for Vision Transformer
by: Heo, Byeongho, et al.
Published: (2024)

Sequence Length Scaling in Vision Transformers for Scientific Images on Frontier
by: Tsaris, Aristeidis, et al.
Published: (2024)

AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer
by: Shan, Jiquan, et al.
Published: (2025)

Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing
by: Dong, Wei, et al.
Published: (2023)

SPoT: Subpixel Placement of Tokens in Vision Transformers
by: Hjelkrem-Tan, Martine, et al.
Published: (2025)

DASViT: Differentiable Architecture Search for Vision Transformer
by: Wu, Pengjin, et al.
Published: (2025)

Instance-Aware Group Quantization for Vision Transformers
by: Moon, Jaehyeon, et al.
Published: (2024)

Vision Transformer-based Adversarial Domain Adaptation
by: Li, Yahan, et al.
Published: (2024)

Elastic Attention Cores for Scalable Vision Transformers
by: Song, Alan Z., et al.
Published: (2026)

Self-Supervised Vision Transformers for Writer Retrieval
by: Raven, Tim, et al.
Published: (2024)

HEAL-SWIN: A Vision Transformer On The Sphere
by: Carlsson, Oscar, et al.
Published: (2023)

A Manifold Representation of the Key in Vision Transformers
by: Meng, Li, et al.
Published: (2024)

Kernel Correlation-Dissimilarity for Multiple Kernel k-Means Clustering
by: Su, Rina, et al.
Published: (2024)

Do VLMs Need Vision Transformers? Evaluating State Space Models as Vision Encoders
by: Kuo, Shang-Jui Ray, et al.
Published: (2026)

WriteViT: Handwritten Text Generation with Vision Transformer
by: Nam, Dang Hoai, et al.
Published: (2025)

Powerful Design of Small Vision Transformer on CIFAR10
by: Wu, Gent
Published: (2025)

From Colors to Classes: Emergence of Concepts in Vision Transformers
by: Dorszewski, Teresa, et al.
Published: (2025)