Neural Collapse Inspired Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Shuoxi, Song, Zijian, He, Kun
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Siamese Transformer Networks for Few-shot Image Classification
by: Jiang, Weihao, et al.
Published: (2024)

You Only Need Less Attention at Each Stage in Vision Transformers
by: Zhang, Shuoxi, et al.
Published: (2024)

Separators in Enhancing Autoregressive Pretraining for Vision Mamba
by: Liu, Hanpeng, et al.
Published: (2026)

Neural Collapse-Inspired Multi-Label Federated Learning under Label-Distribution Skew
by: Peng, Can, et al.
Published: (2025)

iGVLM: Dynamic Instruction-Guided Vision Encoding for Question-Aware Multimodal Understanding
by: Liu, Hanpeng, et al.
Published: (2026)

Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2025)

Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition
by: Wang, Yang, et al.
Published: (2024)

Balance Divergence for Knowledge Distillation
by: Qi, Yafei, et al.
Published: (2025)

ITO: Images and Texts as One via Synergizing Multiple Alignment and Training-Time Fusion
by: Liu, Hanpeng, et al.
Published: (2026)

Sample-level Adaptive Knowledge Distillation for Action Recognition
by: Li, Ping, et al.
Published: (2025)

Visual-Language Model Knowledge Distillation Method for Image Quality Assessment
by: Hou, Yongkang, et al.
Published: (2025)

UNIKD: UNcertainty-filtered Incremental Knowledge Distillation for Neural Implicit Representation
by: Guo, Mengqi, et al.
Published: (2022)

One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion
by: Liu, Jinxi, et al.
Published: (2025)

Remote Sensing Image Classification with Decoupled Knowledge Distillation
by: He, Yaping, et al.
Published: (2025)

Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
by: Li, Mingcheng, et al.
Published: (2024)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
by: Shen, Chaomin, et al.
Published: (2024)

HKD4VLM: A Progressive Hybrid Knowledge Distillation Framework for Robust Multimodal Hallucination and Factuality Detection in VLMs
by: Zhang, Zijian, et al.
Published: (2025)

MiniVLN: Efficient Vision-and-Language Navigation by Progressive Knowledge Distillation
by: Zhu, Junyou, et al.
Published: (2024)

Beyond Modality Collapse: Representations Blending for Multimodal Dataset Distillation
by: Zhang, Xin, et al.
Published: (2025)

Neural Collapse in Test-Time Adaptation
by: Chen, Xiao, et al.
Published: (2025)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Boosting Salient Object Detection with Knowledge Distillated from Large Foundation Models
by: He, Miaoyang, et al.
Published: (2025)

Triple-View Knowledge Distillation for Semi-Supervised Semantic Segmentation
by: Li, Ping, et al.
Published: (2023)

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector
by: Ma, Shuailei, et al.
Published: (2023)

Cross-View Consistency Regularisation for Knowledge Distillation
by: Zhang, Weijia, et al.
Published: (2024)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
by: Wang, Yu, et al.
Published: (2022)

Knowledge Distillation with Refined Logits
by: Sun, Wujie, et al.
Published: (2024)

Frequency Attention for Knowledge Distillation
by: Pham, Cuong, et al.
Published: (2024)

Logit Standardization in Knowledge Distillation
by: Sun, Shangquan, et al.
Published: (2024)

Weakly Supervised Change Detection via Knowledge Distillation and Multiscale Sigmoid Inference
by: Lu, Binghao, et al.
Published: (2024)

Color-Oriented Redundancy Reduction in Dataset Distillation
by: Yuan, Bowen, et al.
Published: (2024)

AdaDistill: Adaptive Knowledge Distillation for Deep Face Recognition
by: Boutros, Fadi, et al.
Published: (2024)

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
by: Chung, Jeannie, et al.
Published: (2026)

ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillation
by: Dhiman, Ankit, et al.
Published: (2023)

Asymmetric Decision-Making in Online Knowledge Distillation:Unifying Consensus and Divergence
by: Chen, Zhaowei, et al.
Published: (2025)

Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfer
by: Chen, Xinyue, et al.
Published: (2024)

DS_FusionNet: Dynamic Dual-Stream Fusion with Bidirectional Knowledge Distillation for Plant Disease Recognition
by: Song, Yanghui, et al.
Published: (2025)

VRM: Knowledge Distillation via Virtual Relation Matching
by: Zhang, Weijia, et al.
Published: (2025)

Learning from Dense Events: Towards Fast Spiking Neural Networks Training via Event Dataset Distillation
by: Ye, Shuhan, et al.
Published: (2025)

Evaluating the Fairness of Neural Collapse in Medical Image Classification
by: Mouheb, Kaouther, et al.
Published: (2024)