Imagen de Portada

Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Yasar, Umut Onur
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Interpreting the Residual Stream of ResNet18
por: Longon, André
Publicado: (2024)

Poly-MgNet: Polynomial Building Blocks in Multigrid-Inspired ResNets
por: van Betteray, Antonia, et al.
Publicado: (2025)

Naturally Computed Scale Invariance in the Residual Stream of ResNet18
por: Longon, André
Publicado: (2025)

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs
por: Kim, Donghyun, et al.
Publicado: (2024)

Powerful Design of Small Vision Transformer on CIFAR10
por: Wu, Gent
Publicado: (2025)

ResNet-50 with Class Reweighting and Anatomy-Guided Temporal Decoding for Gastrointestinal Video Analysis
por: Imtiaz, Romil, et al.
Publicado: (2026)

Integrating Deep Feature Extraction and Hybrid ResNet-DenseNet Model for Multi-Class Abnormality Detection in Endoscopic Images
por: Sagar, Aman, et al.
Publicado: (2024)

SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks
por: Shi, Xinyu, et al.
Publicado: (2024)

94% on CIFAR-10 in 3.29 Seconds on a Single GPU
por: Jordan, Keller
Publicado: (2024)

Image anomaly detection and prediction scheme based on SSA optimized ResNet50-BiGRU model
por: Wan, Qianhui, et al.
Publicado: (2024)

A Comparative Study of CNN, ResNet, and Vision Transformers for Multi-Classification of Chest Diseases
por: Jain, Ananya, et al.
Publicado: (2024)

A Deep Features-Based Approach Using Modified ResNet50 and Gradient Boosting for Visual Sentiments Classification
por: Arslan, Muhammad, et al.
Publicado: (2024)

Medical Image Classification on Imbalanced Data Using ProGAN and SMA-Optimized ResNet: Application to COVID-19
por: Jahromi, Sina, et al.
Publicado: (2025)

BrainRotViT: Transformer-ResNet Hybrid for Explainable Modeling of Brain Aging from 3D sMRI
por: Jalal, Wasif, et al.
Publicado: (2025)

Acute Lymphoblastic Leukemia Diagnosis Employing YOLOv11, YOLOv8, ResNet50, and Inception-ResNet-v2 Deep Learning Models
por: Awad, Alaa, et al.
Publicado: (2025)

SynA-ResNet: Spike-driven ResNet Achieved through OR Residual Connection
por: Shan, Yimeng, et al.
Publicado: (2023)

Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification
por: Gore, Aakash, et al.
Publicado: (2025)

Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
por: Lee, Byung-Kwan, et al.
Publicado: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
por: Zheng, Kaixiang, et al.
Publicado: (2024)

Leveraging SeNet and ResNet Synergy within an Encoder-Decoder Architecture for Glioma Detection
por: V, Pandiyaraju, et al.
Publicado: (2024)

A Neural Architecture Search Method using Auxiliary Evaluation Metric based on ResNet Architecture
por: Wang, Shang, et al.
Publicado: (2025)

PlantDiseaseNet-RT50: A Fine-tuned ResNet50 Architecture for High-Accuracy Plant Disease Detection Beyond Standard CNNs
por: Sagnika, Santwana, et al.
Publicado: (2025)

MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation
por: Sun, Nuolin, et al.
Publicado: (2025)

Do Students Debias Like Teachers? On the Distillability of Bias Mitigation Methods
por: Cheng, Jiali, et al.
Publicado: (2025)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
por: Li, Hui, et al.
Publicado: (2025)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
por: Shen, Chaomin, et al.
Publicado: (2024)

Using ResNet to Utilize 4-class T2-FLAIR Slice Classification Based on the Cholinergic Pathways Hyperintensities Scale for Pathological Aging
por: Tsai, Wei-Chun Kevin, et al.
Publicado: (2023)

The Role of Teacher Calibration in Knowledge Distillation
por: Kim, Suyoung, et al.
Publicado: (2025)

Layer-Wise Relevance Propagation with Conservation Property for ResNet
por: Otsuki, Seitaro, et al.
Publicado: (2024)

PushPull-Net: Inhibition-driven ResNet robust to image corruptions
por: Bennabhaktula, Guru Swaroop, et al.
Publicado: (2024)

Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification
por: Guo, Chenqi, et al.
Publicado: (2025)

EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
por: Chen, Hong Cai, et al.
Publicado: (2025)

CFTS-GAN: Continual Few-Shot Teacher Student for Generative Adversarial Networks
por: Ali, Munsif, et al.
Publicado: (2024)

Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
por: Zhang, Jianhua, et al.
Publicado: (2024)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
por: Parchami-Araghi, Amin, et al.
Publicado: (2024)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
por: Shin, Hyunjune, et al.
Publicado: (2024)

Fourier-Based GAN Fingerprint Detection using ResNet50
por: Erukude, Sai Teja, et al.
Publicado: (2025)

Lung Cancer Classification from CT Images Using ResNet
por: Adekunle, Olajumoke O., et al.
Publicado: (2025)

Continual Distillation of Teachers from Different Domains
por: Michel, Nicolas, et al.
Publicado: (2026)

ReMem: Mutual Information-Aware Fine-tuning of Pretrained Vision Transformers for Effective Knowledge Distillation
por: Dong, Chengyu, et al.
Publicado: (2025)