Copertina

Parameter Reduction Improves Vision Transformers: A Comparative Study of Sharing and Width Reduction

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Kumar, Anantha Padmanaban Krishna
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Mechanisms of Non-Monotonic Scaling in Vision Transformers
di: Kumar, Anantha Padmanaban Krishna
Pubblicazione: (2025)

Semantic Anchors in In-Context Learning: Why Small LLMs Cannot Flip Their Labels
di: Kumar, Anantha Padmanaban Krishna
Pubblicazione: (2025)

Improving Interpretation Faithfulness for Vision Transformers
di: Hu, Lijie, et al.
Pubblicazione: (2023)

Achieving Pareto Optimality using Efficient Parameter Reduction for DNNs in Resource-Constrained Edge Environment
di: Mih, Atah Nuh, et al.
Pubblicazione: (2024)

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention
di: Tian, Zhengyu, et al.
Pubblicazione: (2025)

FairNVT: Improving Fairness via Noise Injection in Vision Transformers
di: Tang, Qiaoyue, et al.
Pubblicazione: (2026)

Improved Cotton Leaf Disease Classification Using Parameter-Efficient Deep Learning Framework
di: Patra, Aswini Kumar, et al.
Pubblicazione: (2024)

DRUPI: Dataset Reduction Using Privileged Information
di: Wang, Shaobo, et al.
Pubblicazione: (2024)

Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling
di: Pantazopoulos, Georgios, et al.
Pubblicazione: (2024)

Topological Alignment of Shared Vision-Language Embedding Space
di: You, Junwon, et al.
Pubblicazione: (2025)

The Shape of Attraction in UMAP: Exploring the Embedding Forces in Dimensionality Reduction
di: Islam, Mohammad Tariqul, et al.
Pubblicazione: (2025)

Transforming Game Play: A Comparative Study of DCQN and DTQN Architectures in Reinforcement Learning
di: Stigall, William A.
Pubblicazione: (2024)

Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
di: Li, Jiaang, et al.
Pubblicazione: (2023)

UNICAD: A Unified Approach for Attack Detection, Noise Reduction and Novel Class Identification
di: Pellicer, Alvaro Lopez, et al.
Pubblicazione: (2024)

HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding
di: Chen, Zhaorun, et al.
Pubblicazione: (2024)

PCaM: A Progressive Focus Attention-Based Information Fusion Method for Improving Vision Transformer Domain Adaptation
di: Zang, Zelin, et al.
Pubblicazione: (2025)

Frozen Vision Transformers for Dense Prediction on Small Datasets: A Case Study in Arrow Localization
di: Shepherd, Maxwell
Pubblicazione: (2026)

From $\mathcal{O}(n^{2})$ to $\mathcal{O}(n)$ Parameters: Quantum Self-Attention in Vision Transformers for Biomedical Image Classification
di: Boucher, Thomas, et al.
Pubblicazione: (2025)

Gaze-Informed Vision Transformers: Predicting Driving Decisions Under Uncertainty
di: Koorathota, Sharath, et al.
Pubblicazione: (2023)

RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function
di: Yu, Yunrui, et al.
Pubblicazione: (2025)

REOrdering Patches Improves Vision Models
di: Kutscher, Declan, et al.
Pubblicazione: (2025)

Block-Recurrent Dynamics in Vision Transformers
di: Jacobs, Mozes, et al.
Pubblicazione: (2025)

CoreDeep: Improving Crack Detection Algorithms Using Width Stochasticity
di: Pandey, Ram Krishna, et al.
Pubblicazione: (2022)

Convolutional Neural Nets vs Vision Transformers: A SpaceNet Case Study with Balanced vs Imbalanced Regimes
di: Gothi, Akshar
Pubblicazione: (2025)

Frequency-Aware Token Reduction for Efficient Vision Transformer
di: Lee, Dong-Jae, et al.
Pubblicazione: (2025)

VariViT: A Vision Transformer for Variable Image Sizes
di: Varma, Aswathi, et al.
Pubblicazione: (2026)

A Survey of the Self Supervised Learning Mechanisms for Vision Transformers
di: Khan, Asifullah, et al.
Pubblicazione: (2024)

Discovering Influential Neuron Path in Vision Transformers
di: Wang, Yifan, et al.
Pubblicazione: (2025)

Accelerating Vision Transformers with Adaptive Patch Sizes
di: Choudhury, Rohan, et al.
Pubblicazione: (2025)

Continual Adaptation of Vision Transformers for Federated Learning
di: Halbe, Shaunak, et al.
Pubblicazione: (2023)

DiffiT: Diffusion Vision Transformers for Image Generation
di: Hatamizadeh, Ali, et al.
Pubblicazione: (2023)

ADAPT to Robustify Prompt Tuning Vision Transformers
di: Eskandar, Masih, et al.
Pubblicazione: (2024)

Class-Discriminative Attention Maps for Vision Transformers
di: Brocki, Lennart, et al.
Pubblicazione: (2023)

Compact Vision Transformer by Reduction of Kernel Complexity
di: Wang, Yancheng, et al.
Pubblicazione: (2025)

Freeze the backbones: A Parameter-Efficient Contrastive Approach to Robust Medical Vision-Language Pre-training
di: Qin, Jiuming, et al.
Pubblicazione: (2024)

Oscillation-Reduced MXFP4 Training for Vision Transformers
di: Chen, Yuxiang, et al.
Pubblicazione: (2025)

Enhancing Vision Transformer Explainability Using Artificial Astrocytes
di: Echevarrieta-Catalan, Nicolas, et al.
Pubblicazione: (2025)

Intriguing Equivalence Structures of the Embedding Space of Vision Transformers
di: Salman, Shaeke, et al.
Pubblicazione: (2024)

FasterViT: Fast Vision Transformers with Hierarchical Attention
di: Hatamizadeh, Ali, et al.
Pubblicazione: (2023)

LipShiFT: A Certifiably Robust Shift-based Vision Transformer
di: Menon, Rohan, et al.
Pubblicazione: (2025)