Cover Image

A Comprehensive Review of Knowledge Distillation in Computer Vision

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Habib, Gousia, Saleem, Tausifa jan, Kaleem, Sheikh Musa, Rouf, Tufail, Lall, Brejesh
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Knowledge Distillation in Vision Transformers: A Critical Review
by: Habib, Gousia, et al.
Published: (2023)

LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression
by: Habib, Gousia, et al.
Published: (2023)

Optimizing Vision Transformers with Data-Free Knowledge Transfer
by: Habib, Gousia, et al.
Published: (2024)

Leveraging band diversity for feature selection in EO data
by: Hussain, Sadia, et al.
Published: (2025)

GraVITON: Graph based garment warping with attention guided inversion for Virtual-tryon
by: Pathak, Sanhita, et al.
Published: (2024)

DiffSTR: Controlled Diffusion Models for Scene Text Removal
by: Pathak, Sanhita, et al.
Published: (2024)

Single Stage Warped Cloth Learning and Semantic-Contextual Attention Feature Fusion for Virtual TryOn
by: Pathak, Sanhita, et al.
Published: (2023)

A Comprehensive Survey on Synthetic Infrared Image synthesis
by: Upadhyay, Avinash, et al.
Published: (2024)

Stride-Net: Fairness-Aware Disentangled Representation Learning for Chest X-Ray Diagnosis
by: Rashid, Darakshan, et al.
Published: (2026)

Harnessing The Power of Attention For Patch-Based Biomedical Image Classification
by: Habib, Gousia, et al.
Published: (2024)

Unified Multi-Dataset Training for TBPS
by: Chatterjee, Nilanjana, et al.
Published: (2026)

Dual Thinking and Logical Processing -- Are Multi-modal Large Language Models Closing the Gap with Human Vision ?
by: Dayanandan, Kailas, et al.
Published: (2024)

Deep Learning-Based Automated Segmentation of Uterine Myomas
by: Saleem, Tausifa Jan, et al.
Published: (2025)

Continual Segmentation under Joint Nonstationarity
by: Pandey, Prashant, et al.
Published: (2026)

DuPLUS: Dual-Prompt Vision-Language Framework for Universal Medical Image Segmentation and Prognosis
by: Saeed, Numan, et al.
Published: (2025)

MedSPOT: A Workflow-Aware Sequential Grounding Benchmark for Clinical GUI
by: Shakeel, Rozain, et al.
Published: (2026)

MOTOR: Multimodal Optimal Transport via Grounded Retrieval in Medical Visual Question Answering
by: Shaaban, Mai A., et al.
Published: (2025)

Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification
by: Habib, Gousia, et al.
Published: (2024)

A Comprehensive Survey on Knowledge Distillation
by: Mansourian, Amir M., et al.
Published: (2025)

Computer Vision-Based Early Detection of Container Loss at Sea
by: Lall, Vishakha, et al.
Published: (2026)

Garbage Vulnerable Point Monitoring using IoT and Computer Vision
by: Kumar, R., et al.
Published: (2025)

Momentum Memory for Knowledge Distillation in Computational Pathology
by: Guo, Yongxin, et al.
Published: (2026)

A Comprehensive Review on Computer Vision Analysis of Aerial Data
by: Tetarwal, Vivek, et al.
Published: (2024)

A Light Weight Multi-Features-View Convolution Neural Network For Plant Disease Identification
by: Khan, Muhammad Kaleem Ullah
Published: (2026)

Task-based Loss Functions in Computer Vision: A Comprehensive Review
by: Elharrouss, Omar, et al.
Published: (2025)

Prompt-Driven Image Analysis with Multimodal Generative AI: Detection, Segmentation, Inpainting, and Interpretation
by: Ahmad, Kaleem
Published: (2025)

Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
by: Zhang, Tiezheng, et al.
Published: (2025)

A Progressive Framework of Vision-language Knowledge Distillation and Alignment for Multilingual Scene
by: Zhang, Wenbo, et al.
Published: (2024)

MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation
by: Zhu, Junyou, et al.
Published: (2024)

Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models
by: Sun, Haoyi, et al.
Published: (2026)

Generalizable Knowledge Distillation from Vision Foundation Models for Semantic Segmentation
by: Lv, Chonghua, et al.
Published: (2026)

Fuzzy Theory in Computer Vision: A Review
by: Yerkin, Adilet, et al.
Published: (2025)

Architectural Insights into Knowledge Distillation for Object Detection: A Comprehensive Review
by: Golizadeh, Mahdi, et al.
Published: (2025)

Computer Vision for Objects used in Group Work: Challenges and Opportunities
by: Jung, Changsoo, et al.
Published: (2025)

Subjective evaluation of UHD video coded using VVC with LCEVC and ML-VVC
by: Ramzan, Naeem, et al.
Published: (2026)

Tracking and Mapping in Medical Computer Vision: A Review
by: Schmidt, Adam, et al.
Published: (2023)

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model
by: Chen, Yifan, et al.
Published: (2024)

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology
by: Vray, Guillaume, et al.
Published: (2023)

TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation
by: Shen, Yehui, et al.
Published: (2024)

Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning
by: Saleem, Tausifa Jan, et al.
Published: (2024)