Cover Image

How Lightweight Can A Vision Transformer Be

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Tan, Jen Hong
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ZonUI-3B: A Lightweight Vision-Language Model for Cross-Resolution GUI Grounding
by: Hsieh, ZongHan, et al.
Published: (2025)

Pre-training of Lightweight Vision Transformers on Small Datasets with Minimally Scaled Images
by: Tan, Jen Hong
Published: (2024)

Token Pruning using a Lightweight Background Aware Vision Transformer
by: Sah, Sudhakar, et al.
Published: (2024)

RT-DETRv2 Explained in 8 Illustrations
by: Chua, Ethan Qi Yang, et al.
Published: (2025)

NuWa: Deriving Lightweight Task-Specific Vision Transformers for Edge Devices
by: Wei, Ziteng, et al.
Published: (2025)

Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision
by: Chatzoudis, Gerasimos, et al.
Published: (2026)

MobileUNETR: A Lightweight End-To-End Hybrid Vision Transformer For Efficient Medical Image Segmentation
by: Perera, Shehan, et al.
Published: (2024)

Vision Bridge Transformer at Scale
by: Tan, Zhenxiong, et al.
Published: (2025)

Representation Separation for Semantic Segmentation with Vision Transformers
by: Hong, Yuanduo, et al.
Published: (2022)

A Lightweight Transformer for Pain Recognition from Brain Activity
by: Gkikas, Stefanos, et al.
Published: (2026)

Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers
by: Lee, Dong Hoon, et al.
Published: (2024)

How Can Multimodal Remote Sensing Datasets Transform Classification via SpatialNet-ViT?
by: Kashyap, Gautam Siddharth, et al.
Published: (2025)

Lightweight, Pre-trained Transformers for Remote Sensing Timeseries
by: Tseng, Gabriel, et al.
Published: (2023)

Reciprocal Attention Mixing Transformer for Lightweight Image Restoration
by: Choi, Haram, et al.
Published: (2023)

Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving
by: Theodoridis, Nikos, et al.
Published: (2026)

DRScaffold: Boosting Dense-Scene Reasoning in Lightweight Vision Language Models
by: Shi, Xinrui, et al.
Published: (2026)

Adapting Lightweight Vision Language Models for Radiological Visual Question Answering
by: Shourya, Aditya, et al.
Published: (2025)

Revisiting KRISP: A Lightweight Reproduction and Analysis of Knowledge-Enhanced Vision-Language Models
by: Dutta, Souradeep, et al.
Published: (2025)

Lightweight Models for Emotional Analysis in Video
by: Nguyen, Quoc-Tien, et al.
Published: (2025)

Cross-Task Multi-Branch Vision Transformer for Facial Expression and Mask Wearing Classification
by: Zhu, Armando, et al.
Published: (2024)

Unified-EGformer: Exposure Guided Lightweight Transformer for Mixed-Exposure Image Enhancement
by: Adhikarla, Eashan, et al.
Published: (2024)

Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving
by: Gopalkrishnan, Akshay, et al.
Published: (2024)

Distilling 3D Spatial Reasoning into a Lightweight Vision-Language Model with CoT
by: Asfour, Alaa, et al.
Published: (2026)

Evaluating Large and Lightweight Vision Models for Irregular Component Segmentation in E-Waste Disassembly
by: Zhang, Xinyao, et al.
Published: (2026)

Benchmarking Unlearning for Vision Transformers
by: Zhao, Kairan, et al.
Published: (2026)

LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks
by: Liu, Hui, et al.
Published: (2025)

Vision Transformers in Precision Agriculture: A Comprehensive Survey
by: Mehdipour, Saber, et al.
Published: (2025)

Large Vision Models Can Solve Mental Rotation Problems
by: Mason, Sebastian Ray, et al.
Published: (2025)

Sensitive Image Classification by Vision Transformers
by: He, Hanxian, et al.
Published: (2024)

The Linear Attention Resurrection in Vision Transformer
by: Zheng, Chuanyang
Published: (2025)

Weierstrass Positional Encoding for Vision Transformers
by: Xin, Zhihang, et al.
Published: (2026)

Spiking Vision Transformer with Saccadic Attention
by: Wang, Shuai, et al.
Published: (2025)

SLTNet: Efficient Event-based Semantic Segmentation with Spike-driven Lightweight Transformer-based Networks
by: Long, Xianlei, et al.
Published: (2024)

LightZeroNav: Zero-Shot Vision Language Navigation in Continuous Environments Based on Lightweight VLMs
by: Luo, Kun, et al.
Published: (2026)

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
by: Dong, Wei, et al.
Published: (2024)

Optimizing Few-Step Sampler for Diffusion Probabilistic Model
by: Huang, Jen-Yuan
Published: (2024)

LCD-Net: A Lightweight Remote Sensing Change Detection Network Combining Feature Fusion and Gating Mechanism
by: Liu, Wenyu, et al.
Published: (2024)

Can Vision-Language Models Understand Construction Workers? An Exploratory Study
by: Bui, Hieu, et al.
Published: (2026)

Mixed Non-linear Quantization for Vision Transformers
by: Kim, Gihwan, et al.
Published: (2024)

Dissecting Query-Key Interaction in Vision Transformers
by: Pan, Xu, et al.
Published: (2024)