Cover Image

Understanding the Role of the Projector in Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Miles, Roy, Mikolajczyk, Krystian
Format:	Preprint
Published:	2023
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning to Project for Cross-Task Knowledge Distillation
by: Auty, Dylan, et al.
Published: (2024)

Language-Based Depth Hints for Monocular Depth Estimation
by: Auty, Dylan, et al.
Published: (2024)

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
by: Miles, Roy, et al.
Published: (2024)

OpenDlign: Open-World Point Cloud Understanding with Depth-Aligned Images
by: Mao, Ye, et al.
Published: (2024)

LLaVA-Octopus: Unlocking Instruction-Driven Adaptive Projector Fusion for Video Understanding
by: Sun, Boyuan, et al.
Published: (2025)

DDOS: The Drone Depth and Obstacle Segmentation Dataset
by: Kolbeinsson, Benedikt, et al.
Published: (2023)

UCorr: Wire Detection and Depth Estimation for Autonomous Drones
by: Kolbeinsson, Benedikt, et al.
Published: (2025)

SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views
by: Huang, Ranran, et al.
Published: (2025)

Multi-Class Segmentation from Aerial Views using Recursive Noise Diffusion
by: Kolbeinsson, Benedikt, et al.
Published: (2022)

No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views
by: Huang, Ranran, et al.
Published: (2025)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

Adaptive Explicit Knowledge Transfer for Knowledge Distillation
by: Park, Hyungkeun, et al.
Published: (2024)

Training-Free Representation Guidance for Diffusion Models with a Representation Alignment Projector
by: Zu, Wenqiang, et al.
Published: (2026)

Device-aware Optical Adversarial Attack for a Portable Projector-camera System
by: Jiang, Ning, et al.
Published: (2025)

QMoP: Query Guided Mixture-of-Projector for Efficient Visual Token Compression
by: Li, Zhongyang, et al.
Published: (2026)

Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matching
by: Jing, Junpeng, et al.
Published: (2024)

Re-purposing SAM into Efficient Visual Projectors for MLLM-Based Referring Image Segmentation
by: Yang, Xiaobo, et al.
Published: (2025)

Cross-Stage Coherence in Hierarchical Driving VQA: Explicit Baselines and Learned Gated Context Projectors
by: Jain, Gautam Kumar, et al.
Published: (2026)

VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections
by: Miles, Roy, et al.
Published: (2024)

POMA-3D: The Point Map Way to 3D Scene Understanding
by: Mao, Ye, et al.
Published: (2025)

Simple Unsupervised Knowledge Distillation With Space Similarity
by: Singh, Aditya, et al.
Published: (2024)

Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
by: Wang, Ziming, et al.
Published: (2023)

Data Upcycling Knowledge Distillation for Image Super-Resolution
by: Zhang, Yun, et al.
Published: (2023)

Robust MLLM Unlearning via Visual Knowledge Distillation
by: Wang, Yuhang, et al.
Published: (2025)

Accelerating Diffusion Models with One-to-Many Knowledge Distillation
by: Zhang, Linfeng, et al.
Published: (2024)

Distilling Cross-Modal Knowledge via Feature Disentanglement
by: Liu, Junhong, et al.
Published: (2025)

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation
by: Li, Guopeng, et al.
Published: (2024)

The Surprising Effectiveness of Canonical Knowledge Distillation for Semantic Segmentation
by: Ali, Muhammad, et al.
Published: (2026)

Review helps learn better: Temporal Supervised Knowledge Distillation
by: Wang, Dongwei, et al.
Published: (2023)

Honeybee: Locality-enhanced Projector for Multimodal LLM
by: Cha, Junbum, et al.
Published: (2023)

A Dynamic Knowledge Distillation Method Based on the Gompertz Curve
by: Yang, Han, et al.
Published: (2025)

Cross Knowledge Distillation between Artificial and Spiking Neural Networks
by: Ye, Shuhan, et al.
Published: (2025)

Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection
by: Yao, Liyi, et al.
Published: (2024)

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
by: Khan, Hikmat, et al.
Published: (2026)

KDMOS:Knowledge Distillation for Motion Segmentation
by: Cao, Chunyu, et al.
Published: (2025)

MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
by: Cao, Jiajun, et al.
Published: (2025)

Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
by: Aubard, Martin, et al.
Published: (2024)

All You Need in Knowledge Distillation Is a Tailored Coordinate System
by: Zhou, Junjie, et al.
Published: (2024)

Early Exit and Multi Stage Knowledge Distillation in VLMs for Video Summarization
by: Khan, Anas Anwarul Haq, et al.
Published: (2025)

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
by: Wei, Guoyizhe, et al.
Published: (2025)