Copertina

Knowledge Distillation via the Target-aware Transformer

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lin, Sihao, Xie, Hongwei, Wang, Bing, Yu, Kaicheng, Chang, Xiaojun, Liang, Xiaodan, Wang, Gang
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MLP Can Be A Good Transformer Learner
di: Lin, Sihao, et al.
Pubblicazione: (2024)

Learning A Zero-shot Occupancy Network from Vision Foundation Models via Self-supervised Adaptation
di: Lin, Sihao, et al.
Pubblicazione: (2025)

Efficient Training of Large Vision Models via Advanced Automated Progressive Learning
di: Li, Changlin, et al.
Pubblicazione: (2024)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
di: Wang, Yu, et al.
Pubblicazione: (2022)

MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving
di: Wang, Haiguang, et al.
Pubblicazione: (2025)

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers
di: Bing, Zhaodong, et al.
Pubblicazione: (2025)

Predicting Genetic Mutation from Whole Slide Images via Biomedical-Linguistic Knowledge Enhanced Multi-label Classification
di: Huang, Gexin, et al.
Pubblicazione: (2024)

Self-Supervised Multi-Frame Neural Scene Flow
di: Liu, Dongrui, et al.
Pubblicazione: (2024)

AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint Synthesis
di: Tang, Tao, et al.
Pubblicazione: (2024)

Knowledge Distillation via Query Selection for Detection Transformer
di: Liu, Yi, et al.
Pubblicazione: (2024)

Lightweight Model Pre-training via Language Guided Knowledge Distillation
di: Li, Mingsheng, et al.
Pubblicazione: (2024)

Teaching with Uncertainty: Unleashing the Potential of Knowledge Distillation in Object Detection
di: Yi, Junfei, et al.
Pubblicazione: (2024)

Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning
di: Cao, Meng, et al.
Pubblicazione: (2025)

DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions
di: Wang, Guangrun, et al.
Pubblicazione: (2024)

Target-aware Bidirectional Fusion Transformer for Aerial Object Tracking
di: Sun, Xinglong, et al.
Pubblicazione: (2025)

Making Large Language Models Better Planners with Reasoning-Decision Alignment
di: Huang, Zhijian, et al.
Pubblicazione: (2024)

Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks
di: Yu, Kairong, et al.
Pubblicazione: (2025)

Contrastive Learning with Counterfactual Explanations for Radiology Report Generation
di: Li, Mingjie, et al.
Pubblicazione: (2024)

TransMamba: Fast Universal Architecture Adaption from Transformers to Mamba
di: Chen, Xiuwei, et al.
Pubblicazione: (2025)

3D Visibility-aware Generalizable Neural Radiance Fields for Interacting Hands
di: Huang, Xuan, et al.
Pubblicazione: (2024)

Target-aware Image Editing via Cycle-consistent Constraints
di: Wang, Yanghao, et al.
Pubblicazione: (2025)

Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
di: Fang, Houzhang, et al.
Pubblicazione: (2025)

Robust MLLM Unlearning via Visual Knowledge Distillation
di: Wang, Yuhang, et al.
Pubblicazione: (2025)

Suppressing Prior-Comparison Hallucinations in Radiology Report Generation via Semantically Decoupled Latent Steering
di: Li, Ao, et al.
Pubblicazione: (2026)

Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes
di: Chen, Jianqi, et al.
Pubblicazione: (2024)

Learning with Semantic Priors: Stabilizing Point-Supervised Infrared Small Target Detection via Hierarchical Knowledge Distillation
di: Yao, Yuanhang, et al.
Pubblicazione: (2026)

VRM: Knowledge Distillation via Virtual Relation Matching
di: Zhang, Weijia, et al.
Pubblicazione: (2025)

BEVLM: Distilling Semantic Knowledge from LLMs into Bird's-Eye View Representations
di: Monninger, Thomas, et al.
Pubblicazione: (2026)

Rethinking Knowledge in Distillation: An In-context Sample Retrieval Perspective
di: Zhu, Jinjing, et al.
Pubblicazione: (2025)

SAMKD: Spatial-aware Adaptive Masking Knowledge Distillation for Object Detection
di: Zhang, Zhourui, et al.
Pubblicazione: (2025)

CLoCKDistill: Consistent Location-and-Context-aware Knowledge Distillation for DETRs
di: Lan, Qizhen, et al.
Pubblicazione: (2025)

360$^\circ$ High-Resolution Depth Estimation via Uncertainty-aware Structural Knowledge Transfer
di: Cao, Zidong, et al.
Pubblicazione: (2023)

Structure-Centric Robust Monocular Depth Estimation via Knowledge Distillation
di: Chen, Runze, et al.
Pubblicazione: (2024)

Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance
di: Wang, Cunzheng, et al.
Pubblicazione: (2024)

CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination
di: Yang, Kaicheng, et al.
Pubblicazione: (2024)

VideoDistill: Language-aware Vision Distillation for Video Question Answering
di: Zou, Bo, et al.
Pubblicazione: (2024)

Enhancing Adaptive Deep Networks for Image Classification via Uncertainty-aware Decision Fusion
di: Zhang, Xu, et al.
Pubblicazione: (2024)

SRKD: Towards Efficient 3D Point Cloud Segmentation via Structure- and Relation-aware Knowledge Distillation
di: Li, Yuqi, et al.
Pubblicazione: (2025)

Improving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation
di: Hong, Zong-Wei, et al.
Pubblicazione: (2024)

A Transformer-in-Transformer Network Utilizing Knowledge Distillation for Image Recognition
di: Rahman, Dewan Tauhid, et al.
Pubblicazione: (2025)