Cover Image

Self-Supervised Quantization-Aware Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Kaiqi, Zhao, Ming
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

Progressive Element-wise Gradient Estimation for Neural Network Quantization
by: Zhao, Kaiqi
Published: (2025)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
by: Cazenavette, George, et al.
Published: (2025)

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

SDQ-LLM: Sigma-Delta Quantization for 1-bit LLMs of any size
by: Xia, Junhao, et al.
Published: (2025)

Dual-Model Weight Selection and Self-Knowledge Distillation for Medical Image Classification
by: Tsutsumi, Ayaka, et al.
Published: (2025)

Self-Supervised Visual Preference Alignment
by: Zhu, Ke, et al.
Published: (2024)

Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation
by: Yan, HongWei, et al.
Published: (2024)

Soft Label Pruning and Quantization for Large-Scale Dataset Distillation
by: Lingao, Xiao, et al.
Published: (2026)

λSplit: Self-Supervised Content-Aware Spectral Unmixing for Fluorescence Microscopy
by: Carrara, Federico, et al.
Published: (2026)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
by: Van Landeghem, Jordy, et al.
Published: (2024)

Generative Dataset Distillation Based on Self-knowledge Distillation
by: Li, Longzhen, et al.
Published: (2025)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

Importance-Aware Adaptive Dataset Distillation
by: Li, Guang, et al.
Published: (2024)

MMS-VPR: Multimodal Street-Level Visual Place Recognition Dataset and Benchmark
by: Ou, Yiwei, et al.
Published: (2025)

BackWeak: Backdooring Knowledge Distillation Simply with Weak Triggers and Fine-tuning
by: Wang, Shanmin, et al.
Published: (2025)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning
by: Song, Changlin, et al.
Published: (2024)

Taming Diffusion for Dataset Distillation with High Representativeness
by: Zhao, Lin, et al.
Published: (2025)

Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustness
by: Tasai, Ren, et al.
Published: (2025)

Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
by: Parchami-Araghi, Amin, et al.
Published: (2024)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
by: Xiang, Jinlin, et al.
Published: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition
by: Feng, Hao, et al.
Published: (2024)

Self-Supervised Learning of Color Constancy
by: Ernst, Markus R., et al.
Published: (2024)

Blockwise Self-Supervised Learning at Scale
by: Siddiqui, Shoaib Ahmed, et al.
Published: (2023)

Masking Improves Contrastive Self-Supervised Learning for ConvNets, and Saliency Tells You Where
by: Chin, Zhi-Yi, et al.
Published: (2023)

Multi-View 3D Reconstruction using Knowledge Distillation
by: Dutt, Aditya, et al.
Published: (2024)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)

PLD: A Choice-Theoretic List-Wise Knowledge Distillation
by: Bassam, Ejafa, et al.
Published: (2025)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

OISD: On-Policy Internal Self-Distillation of Language Models
by: Liu, Xinyu, et al.
Published: (2026)

On Pretraining Data Diversity for Self-Supervised Learning
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

Rethinking The Uniformity Metric in Self-Supervised Learning
by: Fang, Xianghong, et al.
Published: (2024)

Matrix Information Theory for Self-Supervised Learning
by: Zhang, Yifan, et al.
Published: (2023)

Magnification-Aware Distillation (MAD): A Self-Supervised Framework for Unified Representation Learning in Gigapixel Whole-Slide Images
by: Gokmen, Mahmut S., et al.
Published: (2025)