Copertina

A Transformer-in-Transformer Network Utilizing Knowledge Distillation for Image Recognition

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Rahman, Dewan Tauhid, Sarker, Yeahia, Mazumder, Antar, Anower, Md. Shamim
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

BdSL-SPOTER: A Transformer-Based Framework for Bengali Sign Language Recognition with Cultural Adaptation
di: Azad, Sayad Ibna, et al.
Pubblicazione: (2025)

Knowledge Distillation in Vision Transformers: A Critical Review
di: Habib, Gousia, et al.
Pubblicazione: (2023)

Knowledge Distillation via the Target-aware Transformer
di: Lin, Sihao, et al.
Pubblicazione: (2022)

Analyzing Transformer Models and Knowledge Distillation Approaches for Image Captioning on Edge AI
di: Kwok, Wing Man Casca, et al.
Pubblicazione: (2025)

An Exploratory Approach Towards Investigating and Explaining Vision Transformer and Transfer Learning for Brain Disease Detection
di: Sarker, Shuvashis, et al.
Pubblicazione: (2025)

Knowledge Distillation via Query Selection for Detection Transformer
di: Liu, Yi, et al.
Pubblicazione: (2024)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
di: Wang, Yu, et al.
Pubblicazione: (2022)

Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Images
di: Jahin, Md Abrar, et al.
Pubblicazione: (2025)

LumiNet: Perception-Driven Knowledge Distillation via Statistical Logit Calibration
di: Hossain, Md. Ismail, et al.
Pubblicazione: (2023)

WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imaging
di: Rahman, Md. Abdur, et al.
Pubblicazione: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
di: Zheng, Kaixiang, et al.
Pubblicazione: (2024)

VR-FuseNet: A Fusion of Heterogeneous Fundus Data and Explainable Deep Network for Diabetic Retinopathy Classification
di: Refat, Shamim Rahim, et al.
Pubblicazione: (2025)

MV-Swin-T: Mammogram Classification with Multi-view Swin Transformer
di: Sarker, Sushmita, et al.
Pubblicazione: (2024)

Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation
di: Li, Hangyu, et al.
Pubblicazione: (2024)

AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognition
di: Boutros, Fadi, et al.
Pubblicazione: (2024)

A Source-Free Approach for Domain Adaptation via Multiview Image Transformation and Latent Space Consistency
di: Sutradhar, Debopom, et al.
Pubblicazione: (2026)

Diffusion Transformer-to-Mamba Distillation for High-Resolution Image Generation
di: Yao, Yuan, et al.
Pubblicazione: (2025)

Distilled Pooling Transformer Encoder for Efficient Realistic Image Dehazing
di: Tran, Le-Anh, et al.
Pubblicazione: (2024)

Image Recognition with Online Lightweight Vision Transformer: A Survey
di: Zhang, Zherui, et al.
Pubblicazione: (2025)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
di: Guo, Guangyu, et al.
Pubblicazione: (2021)

Gasformer: A Transformer-based Architecture for Segmenting Methane Emissions from Livestock in Optical Gas Imaging
di: Sarker, Toqi Tahamid, et al.
Pubblicazione: (2024)

HTR-JAND: Handwritten Text Recognition with Joint Attention Network and Knowledge Distillation
di: Hamdan, Mohammed, et al.
Pubblicazione: (2024)

SITAR: Semi-supervised Image Transformer for Action Recognition
di: Iqbal, Owais, et al.
Pubblicazione: (2024)

Teacher-Guided One-Shot Pruning via Context-Aware Knowledge Distillation
di: Alim, Md. Samiul, et al.
Pubblicazione: (2025)

Autoregressive Distillation of Diffusion Transformers
di: Kim, Yeongmin, et al.
Pubblicazione: (2025)

A Heterogeneous Two-Stream Framework for Video Action Recognition with Comparative Fusion Analysis
di: Rahaman, Md. Afzalur, et al.
Pubblicazione: (2026)

DSVTLA: Deep Swin Vision Transformer-Based Transfer Learning Architecture for Multi-Type Cancer Histopathological Cancer Image Classification
di: Khan, Muazzem Hussain, et al.
Pubblicazione: (2026)

Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models
di: Miriyala, Srinivas Soumitri, et al.
Pubblicazione: (2026)

Dark Transformer: A Video Transformer for Action Recognition in the Dark
di: Ulhaq, Anwaar
Pubblicazione: (2024)

CAST: Channel-Aware Spatial Transfer Learning with Pseudo-Image Radar for Sign Language Recognition
di: Shujon, Md. Shakhoyat Rahman, et al.
Pubblicazione: (2026)

CATFace: Cross-Attribute-Guided Transformer with Self-Attention Distillation for Low-Quality Face Recognition
di: Talemi, Niloufar Alipour, et al.
Pubblicazione: (2024)

Handcrafted Feature Fusion for Reliable Detection of AI-Generated Images
di: Nirob, Syed Mehedi Hasan, et al.
Pubblicazione: (2026)

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers
di: Bing, Zhaodong, et al.
Pubblicazione: (2025)

BanglaNet: Bangla Handwritten Character Recognition using Ensembling of Convolutional Neural Network
di: Saha, Chandrika, et al.
Pubblicazione: (2024)

Sample-level Adaptive Knowledge Distillation for Action Recognition
di: Li, Ping, et al.
Pubblicazione: (2025)

Developing a Dual-Stage Vision Transformer Model for Lung Disease Classification
di: Mazumder, Anirudh, et al.
Pubblicazione: (2024)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
di: Son, Seungwoo, et al.
Pubblicazione: (2023)

Knowledge Distillation of Convolutional Neural Networks through Feature Map Transformation using Decision Trees
di: Srinivas, Maddimsetti, et al.
Pubblicazione: (2024)

Vision Transformers with Self-Distilled Registers
di: Chen, Yinjie, et al.
Pubblicazione: (2025)

HyFormer-Net: A Synergistic CNN-Transformer with Interpretable Multi-Scale Fusion for Breast Lesion Segmentation and Classification in Ultrasound Images
di: Rahman, Mohammad Amanour
Pubblicazione: (2025)