Cover Image

Simple Unsupervised Knowledge Distillation With Space Similarity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Singh, Aditya, Wang, Haohan
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection
by: Yao, Liyi, et al.
Published: (2024)

DreamMotion: Space-Time Self-Similar Score Distillation for Zero-Shot Video Editing
by: Jeong, Hyeonho, et al.
Published: (2024)

Improving Noise Efficiency in Privacy-preserving Dataset Distillation
by: Zheng, Runkai, et al.
Published: (2025)

HMID-Net: An Exploration of Masked Image Modeling and Knowledge Distillation in Hyperbolic Space
by: Wang, Changli, et al.
Published: (2025)

LIFT and PLACE: A Simple, Stable, and Effective Knowledge Distillation Framework for Lightweight Diffusion Models
by: Han, Hyunsoo, et al.
Published: (2026)

Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models
by: Zhou, Andy, et al.
Published: (2023)

Multi-View 3D Reconstruction using Knowledge Distillation
by: Dutt, Aditya, et al.
Published: (2024)

CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation
by: Govindarajan, Hariprasath, et al.
Published: (2025)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
by: Mistretta, Marco, et al.
Published: (2024)

Unsupervised Domain Adaptation via Similarity-based Prototypes for Cross-Modality Segmentation
by: Ye, Ziyu, et al.
Published: (2025)

Classifier-guided CLIP Distillation for Unsupervised Multi-label Classification
by: Kim, Dongseob, et al.
Published: (2025)

Adaptive Explicit Knowledge Transfer for Knowledge Distillation
by: Park, Hyungkeun, et al.
Published: (2024)

UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulation
by: Tang, Yihe, et al.
Published: (2025)

Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
by: Wang, Ziming, et al.
Published: (2023)

SlotMatch: Distilling Object-Centric Representations for Unsupervised Video Segmentation
by: Grigore, Diana-Nicoleta, et al.
Published: (2025)

Review helps learn better: Temporal Supervised Knowledge Distillation
by: Wang, Dongwei, et al.
Published: (2023)

Robust MLLM Unlearning via Visual Knowledge Distillation
by: Wang, Yuhang, et al.
Published: (2025)

Understanding the Role of the Projector in Knowledge Distillation
by: Miles, Roy, et al.
Published: (2023)

Dataset Distillation via the Wasserstein Metric
by: Liu, Haoyang, et al.
Published: (2023)

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation
by: Li, Guopeng, et al.
Published: (2024)

Data Upcycling Knowledge Distillation for Image Super-Resolution
by: Zhang, Yun, et al.
Published: (2023)

Learning to Project for Cross-Task Knowledge Distillation
by: Auty, Dylan, et al.
Published: (2024)

Cross Knowledge Distillation between Artificial and Spiking Neural Networks
by: Ye, Shuhan, et al.
Published: (2025)

CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Space
by: Lim, Sohwi, et al.
Published: (2026)

Accelerating Diffusion Models with One-to-Many Knowledge Distillation
by: Zhang, Linfeng, et al.
Published: (2024)

Distilling Cross-Modal Knowledge via Feature Disentanglement
by: Liu, Junhong, et al.
Published: (2025)

The Surprising Effectiveness of Canonical Knowledge Distillation for Semantic Segmentation
by: Ali, Muhammad, et al.
Published: (2026)

AKGNet: Attribute Knowledge-Guided Unsupervised Lung-Infected Area Segmentation
by: En, Qing, et al.
Published: (2024)

A Dynamic Knowledge Distillation Method Based on the Gompertz Curve
by: Yang, Han, et al.
Published: (2025)

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
by: Khan, Hikmat, et al.
Published: (2026)

KDMOS:Knowledge Distillation for Motion Segmentation
by: Cao, Chunyu, et al.
Published: (2025)

Powerful Teachers Matter: Text-Guided Multi-view Knowledge Distillation with Visual Prior Enhancement
by: Zhang, Xin, et al.
Published: (2026)

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization
by: Kang, Seongjae, et al.
Published: (2025)

Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
by: Aubard, Martin, et al.
Published: (2024)

All You Need in Knowledge Distillation Is a Tailored Coordinate System
by: Zhou, Junjie, et al.
Published: (2024)

$V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
by: Miles, Roy, et al.
Published: (2024)

MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders
by: Cao, Jiajun, et al.
Published: (2025)

Early Exit and Multi Stage Knowledge Distillation in VLMs for Video Summarization
by: Khan, Anas Anwarul Haq, et al.
Published: (2025)

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
by: Wei, Guoyizhe, et al.
Published: (2025)

Investigating Fine- and Coarse-grained Structural Correspondences Between Deep Neural Networks and Human Object Image Similarity Judgments Using Unsupervised Alignment
by: Takahashi, Soh, et al.
Published: (2025)