Image de couverture de livre

CanKD: Cross-Attention-based Non-local operation for Feature-based Knowledge Distillation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Sun, Shizhe, Ohyama, Wataru
Format:	Preprint
Publié:	2025
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

EA-KD: Entropy-based Adaptive Knowledge Distillation
par: Su, Chi-Ping, et autres
Publié: (2023)

CrossKD: Cross-Head Knowledge Distillation for Object Detection
par: Wang, Jiabao, et autres
Publié: (2023)

ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation
par: Lan, Qizhen, et autres
Publié: (2025)

TopKD: Top-scaled Knowledge Distillation
par: Wang, Qi, et autres
Publié: (2025)

ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical Images
par: Ge, Hongyu, et autres
Publié: (2025)

MoKD: Multi-Task Optimization for Knowledge Distillation
par: Hayder, Zeeshan, et autres
Publié: (2025)

BD-KD: Balancing the Divergences for Online Knowledge Distillation
par: Amara, Ibtihel, et autres
Publié: (2022)

Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models
par: Sun, Haoyi, et autres
Publié: (2026)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
par: Wang, Yu, et autres
Publié: (2022)

FreeKD: Knowledge Distillation via Semantic Frequency Prompt
par: Zhang, Yuan, et autres
Publié: (2023)

AgriKD: Cross-Architecture Knowledge Distillation for Efficient Leaf Disease Classification
par: Le, Minh-Dung, et autres
Publié: (2026)

MapKD: Unlocking Prior Knowledge with Cross-Modal Distillation for Efficient Online HD Map Construction
par: Yan, Ziyang, et autres
Publié: (2025)

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model
par: Chen, Yifan, et autres
Publié: (2024)

Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model
par: Feng, Qianhan, et autres
Publié: (2024)

KD360-VoxelBEV: LiDAR and 360-degree Camera Cross Modality Knowledge Distillation for Bird's-Eye-View Segmentation
par: E, Wenke, et autres
Publié: (2025)

VLM-KD: Knowledge Distillation from VLM for Long-Tail Visual Recognition
par: Zhang, Zaiwei, et autres
Publié: (2024)

MST-KD: Multiple Specialized Teachers Knowledge Distillation for Fair Face Recognition
par: Caldeira, Eduarda, et autres
Publié: (2024)

TIE-KD: Teacher-Independent and Explainable Knowledge Distillation for Monocular Depth Estimation
par: Choi, Sangwon, et autres
Publié: (2024)

StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation
par: Kao, Shiu-hong, et autres
Publié: (2023)

REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification
par: Chen, Hongzhao, et autres
Publié: (2025)

Uncertainty-Aware Knowledge Distillation for Multimodal Large Language Models
par: Sun, Jingchen, et autres
Publié: (2026)

CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation
par: Lee, Jungsoo, et autres
Publié: (2025)

AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation
par: Babnik, Žiga, et autres
Publié: (2024)

DiffKD-DCIS: Predicting Upgrade of Ductal Carcinoma In Situ with Diffusion Augmentation and Knowledge Distillation
par: Li, Tao, et autres
Publié: (2026)

MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
par: Cao, Jiajun, et autres
Publié: (2025)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
par: Kim, Hyungmin, et autres
Publié: (2022)

xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR
par: Pathmanathan, Thenukan, et autres
Publié: (2026)

Frequency Attention for Knowledge Distillation
par: Pham, Cuong, et autres
Publié: (2024)

DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models
par: Kim, Sungnyun, et autres
Publié: (2024)

Channel Attention-Guided Cross-Modal Knowledge Distillation for Referring Image Segmentation
par: Yang, Chen
Publié: (2026)

CLIP-KD: An Empirical Study of CLIP Model Distillation
par: Yang, Chuanguang, et autres
Publié: (2023)

LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection
par: Kim, Sanmin, et autres
Publié: (2024)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
par: Lo, Ka Man, et autres
Publié: (2024)

Distilling Cross-Modal Knowledge via Feature Disentanglement
par: Liu, Junhong, et autres
Publié: (2025)

RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
par: Bang, Geonho, et autres
Publié: (2024)

ReCo-KD: Region- and Context-Aware Knowledge Distillation for Efficient 3D Medical Image Segmentation
par: Lan, Qizhen, et autres
Publié: (2026)

TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
par: Liu, Ruiping, et autres
Publié: (2022)

PromptKD: Unsupervised Prompt Distillation for Vision-Language Models
par: Li, Zheng, et autres
Publié: (2024)

Exploring Graph-based Knowledge: Multi-Level Feature Distillation via Channels Relational Graph
par: Wang, Zhiwei, et autres
Publié: (2024)

Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
par: Fang, Houzhang, et autres
Publié: (2025)