Imagen de Portada

Adaptive Teaching with Shared Classifier for Knowledge Distillation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jang, Jaeyeon, Kim, Young-Ik, Lim, Jisu, Lee, Hyeonseong
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Highlight Every Step: Knowledge Distillation via Collaborative Teaching
por: Zhao, Haoran, et al.
Publicado: (2019)

TopP&R: Robust Support Estimation Approach for Evaluating Fidelity and Diversity in Generative Models
por: Kim, Pum Jun, et al.
Publicado: (2023)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
por: Matsuyama, Kazuhiro, et al.
Publicado: (2025)

Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Features
por: Lee, Jewon, et al.
Publicado: (2025)

Retrieval-Augmented Score Distillation for Text-to-3D Generation
por: Seo, Junyoung, et al.
Publicado: (2024)

The Role of Teacher Calibration in Knowledge Distillation
por: Kim, Suyoung, et al.
Publicado: (2025)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
por: Son, Seungwoo, et al.
Publicado: (2023)

Efficient Distillation of Classifier-Free Guidance using Adapters
por: Jensen, Cristian Perez, et al.
Publicado: (2025)

CLIP Can Understand Depth
por: Kim, Sohee, et al.
Publicado: (2024)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
por: Kim, Hyungmin, et al.
Publicado: (2022)

ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation
por: Doshi, Divyang, et al.
Publicado: (2024)

D-TPT: Dimensional Entropy Maximization for Calibrating Test-Time Prompt Tuning in Vision-Language Models
por: Han, Jisu, et al.
Publicado: (2025)

Optimizing Parking Space Classification: Distilling Ensembles into Lightweight Classifiers
por: Alves, Paulo Luza, et al.
Publicado: (2024)

Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
por: Moon, Jaeho, et al.
Publicado: (2024)

PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor
por: Jung, Jaewon, et al.
Publicado: (2024)

Weakly Supervised Pretraining and Multi-Annotator Supervised Finetuning for Facial Wrinkle Detection
por: Moon, Ik Jun, et al.
Publicado: (2024)

Collaborative Learning with Multiple Foundation Models for Source-Free Domain Adaptation
por: Lee, Huisoo, et al.
Publicado: (2025)

Distilling the Knowledge in Data Pruning
por: Ben-Baruch, Emanuel, et al.
Publicado: (2024)

DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection
por: Lim, Yewon, et al.
Publicado: (2024)

Delta Rectified Flow Sampling for Text-to-Image Editing
por: Beaudouin, Gaspard, et al.
Publicado: (2025)

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization
por: Kang, Seongjae, et al.
Publicado: (2025)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
por: Zhang, Qifan, et al.
Publicado: (2024)

Semantic Prompting with Image-Token for Continual Learning
por: Han, Jisu, et al.
Publicado: (2024)

Ranked Entropy Minimization for Continual Test-Time Adaptation
por: Han, Jisu, et al.
Publicado: (2025)

Advanced Knowledge Transfer: Refined Feature Distillation for Zero-Shot Quantization in Edge Computing
por: Hong, Inpyo, et al.
Publicado: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
por: Shi, Zenglin, et al.
Publicado: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
por: Sadeghi, Mohammadreza, et al.
Publicado: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
por: Zheng, Kaixiang, et al.
Publicado: (2024)

Improving Neural ODEs via Knowledge Distillation
por: Chu, Haoyu, et al.
Publicado: (2022)

Data-Augmented Quantization-Aware Knowledge Distillation
por: Kur, Justin, et al.
Publicado: (2025)

Exploiting Autoencoder's Weakness to Generate Pseudo Anomalies
por: Astrid, Marcella, et al.
Publicado: (2024)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
por: Guo, Guangyu, et al.
Publicado: (2021)

LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression
por: Habib, Gousia, et al.
Publicado: (2023)

Preview-based Category Contrastive Learning for Knowledge Distillation
por: Ding, Muhe, et al.
Publicado: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
por: Yuan, Hua, et al.
Publicado: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
por: Huang, Yanglin, et al.
Publicado: (2025)

Optimizing Few-Step Generation with Adaptive Matching Distillation
por: Bai, Lichen, et al.
Publicado: (2026)

Spectral Gradient Surgery for Domain-Generalizable Dataset Distillation
por: Oh, Minyoung, et al.
Publicado: (2026)

Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers
por: Nguyen, Thanh Thi, et al.
Publicado: (2024)

When Test-Time Adaptation Meets Self-Supervised Models
por: Han, Jisu, et al.
Publicado: (2025)