Saved in:
| Main Authors: | Yang, Han, Qin, Guangjun |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.21649 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Gompertz Linear Units: Leveraging Asymmetry for Enhanced Learning Dynamics
by: Das, Indrashis, et al.
Published: (2025)
by: Das, Indrashis, et al.
Published: (2025)
A Survey on Mamba Architecture for Vision Applications
by: Ibrahim, Fady, et al.
Published: (2025)
by: Ibrahim, Fady, et al.
Published: (2025)
Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)
by: Wei, Yukang, et al.
Published: (2024)
Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
by: Wang, Ziming, et al.
Published: (2023)
by: Wang, Ziming, et al.
Published: (2023)
Beyond ZOH: Advanced Discretization Strategies for Vision Mamba
by: Ibrahim, Fady, et al.
Published: (2026)
by: Ibrahim, Fady, et al.
Published: (2026)
LIFT and PLACE: A Simple, Stable, and Effective Knowledge Distillation Framework for Lightweight Diffusion Models
by: Han, Hyunsoo, et al.
Published: (2026)
by: Han, Hyunsoo, et al.
Published: (2026)
Review helps learn better: Temporal Supervised Knowledge Distillation
by: Wang, Dongwei, et al.
Published: (2023)
by: Wang, Dongwei, et al.
Published: (2023)
Adaptive Explicit Knowledge Transfer for Knowledge Distillation
by: Park, Hyungkeun, et al.
Published: (2024)
by: Park, Hyungkeun, et al.
Published: (2024)
Towards Effective Data-Free Knowledge Distillation via Diverse Diffusion Augmentation
by: Li, Muquan, et al.
Published: (2024)
by: Li, Muquan, et al.
Published: (2024)
Distilling Cross-Modal Knowledge via Feature Disentanglement
by: Liu, Junhong, et al.
Published: (2025)
by: Liu, Junhong, et al.
Published: (2025)
A Novel Spike Transformer Network for Depth Estimation from Event Cameras via Cross-modality Knowledge Distillation
by: Zhang, Xin, et al.
Published: (2024)
by: Zhang, Xin, et al.
Published: (2024)
Understanding the Role of the Projector in Knowledge Distillation
by: Miles, Roy, et al.
Published: (2023)
by: Miles, Roy, et al.
Published: (2023)
Learning to Project for Cross-Task Knowledge Distillation
by: Auty, Dylan, et al.
Published: (2024)
by: Auty, Dylan, et al.
Published: (2024)
Simple Unsupervised Knowledge Distillation With Space Similarity
by: Singh, Aditya, et al.
Published: (2024)
by: Singh, Aditya, et al.
Published: (2024)
Distilling Future Temporal Knowledge with Masked Feature Reconstruction for 3D Object Detection
by: Zheng, Haowen, et al.
Published: (2025)
by: Zheng, Haowen, et al.
Published: (2025)
Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)
by: Yang, Penghui, et al.
Published: (2023)
Robust MLLM Unlearning via Visual Knowledge Distillation
by: Wang, Yuhang, et al.
Published: (2025)
by: Wang, Yuhang, et al.
Published: (2025)
Accelerating Diffusion Models with One-to-Many Knowledge Distillation
by: Zhang, Linfeng, et al.
Published: (2024)
by: Zhang, Linfeng, et al.
Published: (2024)
Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation
by: Li, Guopeng, et al.
Published: (2024)
by: Li, Guopeng, et al.
Published: (2024)
Data Upcycling Knowledge Distillation for Image Super-Resolution
by: Zhang, Yun, et al.
Published: (2023)
by: Zhang, Yun, et al.
Published: (2023)
The Surprising Effectiveness of Canonical Knowledge Distillation for Semantic Segmentation
by: Ali, Muhammad, et al.
Published: (2026)
by: Ali, Muhammad, et al.
Published: (2026)
Lightweight Remote Sensing Scene Classification on Edge Devices via Knowledge Distillation and Early-exit
by: Zhao, Yang, et al.
Published: (2025)
by: Zhao, Yang, et al.
Published: (2025)
PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation
by: Hwang, Injoon, et al.
Published: (2024)
by: Hwang, Injoon, et al.
Published: (2024)
Dynamic-Aware Video Distillation: Optimizing Temporal Resolution Based on Video Semantics
by: Zhao, Yinjie, et al.
Published: (2025)
by: Zhao, Yinjie, et al.
Published: (2025)
KDMOS:Knowledge Distillation for Motion Segmentation
by: Cao, Chunyu, et al.
Published: (2025)
by: Cao, Chunyu, et al.
Published: (2025)
Cross Knowledge Distillation between Artificial and Spiking Neural Networks
by: Ye, Shuhan, et al.
Published: (2025)
by: Ye, Shuhan, et al.
Published: (2025)
Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection
by: Yao, Liyi, et al.
Published: (2024)
by: Yao, Liyi, et al.
Published: (2024)
MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
by: Khan, Hikmat, et al.
Published: (2026)
by: Khan, Hikmat, et al.
Published: (2026)
Dynamic Weight Adjustment for Knowledge Distillation: Leveraging Vision Transformer for High-Accuracy Lung Cancer Detection and Real-Time Deployment
by: Khan, Saif Ur Rehman, et al.
Published: (2025)
by: Khan, Saif Ur Rehman, et al.
Published: (2025)
HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
by: Zhu, Songfeng
Published: (2026)
by: Zhu, Songfeng
Published: (2026)
Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)
by: Kim, Taeheon, et al.
Published: (2025)
MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
by: Cao, Jiajun, et al.
Published: (2025)
by: Cao, Jiajun, et al.
Published: (2025)
Early Exit and Multi Stage Knowledge Distillation in VLMs for Video Summarization
by: Khan, Anas Anwarul Haq, et al.
Published: (2025)
by: Khan, Anas Anwarul Haq, et al.
Published: (2025)
ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
by: Wei, Guoyizhe, et al.
Published: (2025)
by: Wei, Guoyizhe, et al.
Published: (2025)
Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
by: Aubard, Martin, et al.
Published: (2024)
by: Aubard, Martin, et al.
Published: (2024)
All You Need in Knowledge Distillation Is a Tailored Coordinate System
by: Zhou, Junjie, et al.
Published: (2024)
by: Zhou, Junjie, et al.
Published: (2024)
$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
by: Miles, Roy, et al.
Published: (2024)
by: Miles, Roy, et al.
Published: (2024)
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications
by: Van Landeghem, Jordy, et al.
Published: (2024)
by: Van Landeghem, Jordy, et al.
Published: (2024)
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)
by: Lv, Jiaming, et al.
Published: (2024)
REFINE-CONTROL: A Semi-supervised Distillation Method For Conditional Image Generation
by: Jiang, Yicheng, et al.
Published: (2025)
by: Jiang, Yicheng, et al.
Published: (2025)
Similar Items
-
Gompertz Linear Units: Leveraging Asymmetry for Enhanced Learning Dynamics
by: Das, Indrashis, et al.
Published: (2025) -
A Survey on Mamba Architecture for Vision Applications
by: Ibrahim, Fady, et al.
Published: (2025) -
Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024) -
Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
by: Wang, Ziming, et al.
Published: (2023) -
Beyond ZOH: Advanced Discretization Strategies for Vision Mamba
by: Ibrahim, Fady, et al.
Published: (2026)