Copertina

Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Hongjun, Xiao, Li, Zhang, Xingkuo, Miao, Yining
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
di: Huang, Yanglin, et al.
Pubblicazione: (2025)

Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation
di: Ren, Weining, et al.
Pubblicazione: (2025)

Multi-Level Decoupled Relational Distillation for Heterogeneous Architectures
di: Yang, Yaoxin, et al.
Pubblicazione: (2025)

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
di: Zhou, Yunshuai, et al.
Pubblicazione: (2024)

Preview-based Category Contrastive Learning for Knowledge Distillation
di: Ding, Muhe, et al.
Pubblicazione: (2024)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
di: Xiang, Qianlong, et al.
Pubblicazione: (2024)

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation
di: Lin, Jhe-Hao, et al.
Pubblicazione: (2025)

HAD: Heterogeneity-Aware Distillation for Lifelong Heterogeneous Learning
di: Zhang, Xuerui, et al.
Pubblicazione: (2026)

KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder
di: Bora, Maheswar, et al.
Pubblicazione: (2024)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
di: Li, Yuqi, et al.
Pubblicazione: (2025)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
di: Ma, Jing, et al.
Pubblicazione: (2022)

Promoting CNNs with Cross-Architecture Knowledge Distillation for Efficient Monocular Depth Estimation
di: Zheng, Zhimeng, et al.
Pubblicazione: (2024)

CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective
di: Zhu, Wencheng, et al.
Pubblicazione: (2024)

Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation
di: Ousalah, Nassim Ali, et al.
Pubblicazione: (2025)

UHKD: A Unified Framework for Heterogeneous Knowledge Distillation via Frequency-Domain Representations
di: Yu, Fengming, et al.
Pubblicazione: (2025)

Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
di: Wang, Ziming, et al.
Pubblicazione: (2023)

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation
di: Li, Guopeng, et al.
Pubblicazione: (2024)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
di: Shao, Renrong, et al.
Pubblicazione: (2025)

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model
di: Chen, Yifan, et al.
Pubblicazione: (2024)

Cross-Architecture Distillation Made Simple with Redundancy Suppression
di: Zhang, Weijia, et al.
Pubblicazione: (2025)

Scale-Aware Contrastive Reverse Distillation for Unsupervised Medical Anomaly Detection
di: Li, Chunlei, et al.
Pubblicazione: (2025)

Heterogeneous Complementary Distillation
di: Xu, Liuchi, et al.
Pubblicazione: (2025)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
di: Yuan, Hua, et al.
Pubblicazione: (2025)

Intra-class Patch Swap for Self-Distillation
di: Choi, Hongjun, et al.
Pubblicazione: (2025)

Revealing the Power of Post-Training for Small Language Models via Knowledge Distillation
di: Rang, Miao, et al.
Pubblicazione: (2025)

Aligned Contrastive Loss for Long-Tailed Recognition
di: Ma, Jiali, et al.
Pubblicazione: (2025)

Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
di: Guo, Ziyao, et al.
Pubblicazione: (2023)

Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approach
di: Backhaus, Anton, et al.
Pubblicazione: (2025)

Searching a Compact Architecture for Robust Multi-Exposure Image Fusion
di: Liu, Zhu, et al.
Pubblicazione: (2023)

MobiAct: Efficient MAV Action Recognition Using MobileNetV4 with Contrastive Learning and Knowledge Distillation
di: Nengbo, Zhang, et al.
Pubblicazione: (2025)

Balance Divergence for Knowledge Distillation
di: Qi, Yafei, et al.
Pubblicazione: (2025)

Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model
di: Feng, Qianhan, et al.
Pubblicazione: (2024)

Aligning Medical Images with General Knowledge from Large Language Models
di: Fang, Xiao, et al.
Pubblicazione: (2024)

Pixel-Wise Contrastive Distillation
di: Huang, Junqiang, et al.
Pubblicazione: (2022)

Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillation
di: Lu, Andong, et al.
Pubblicazione: (2024)

Data-free Knowledge Distillation with Diffusion Models
di: Qi, Xiaohua, et al.
Pubblicazione: (2025)

Class Incremental Medical Image Segmentation via Prototype-Guided Calibration and Dual-Aligned Distillation
di: Zhu, Shengqian, et al.
Pubblicazione: (2025)

DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection
di: Zhang, Zhourui, et al.
Pubblicazione: (2024)

Simple Unsupervised Knowledge Distillation With Space Similarity
di: Singh, Aditya, et al.
Pubblicazione: (2024)

Prior Knowledge Distillation Network for Face Super-Resolution
di: Yang, Qiu, et al.
Pubblicazione: (2024)