Cover Image

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kang, Seongjae, Lee, Dong Bok, Jang, Hyungjoon, Hwang, Sung Ju
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PCoreSet: Effective Active Learning through Knowledge Distillation from Vision-Language Models
by: Kang, Seongjae, et al.
Published: (2025)

Visualizing the loss landscape of Self-supervised Vision Transformer
by: Lee, Youngwan, et al.
Published: (2024)

MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
by: Lee, Youngwan, et al.
Published: (2026)

Betrayed by Attention: A Simple yet Effective Approach for Self-supervised Video Object Segmentation
by: Ding, Shuangrui, et al.
Published: (2023)

Concept-skill Transferability-based Data Selection for Large Vision-Language Models
by: Lee, Jaewoo, et al.
Published: (2024)

HoliSafe: Holistic Safety Benchmarking and Modeling for Vision-Language Model
by: Lee, Youngwan, et al.
Published: (2025)

DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
by: Li, Chenyang, et al.
Published: (2026)

Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation
by: Huang, Kaiwen, et al.
Published: (2024)

Online Open-set Semi-supervised Object Detection with Dual Competing Head
by: Wang, Zerun, et al.
Published: (2023)

Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting
by: Kim, Beomyoung, et al.
Published: (2024)

Towards Semi-supervised Dual-modal Semantic Segmentation
by: Dong, Qiulei, et al.
Published: (2024)

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
by: Chung, Jeannie, et al.
Published: (2026)

A Simple yet Effective Layout Token in Large Language Models for Document Understanding
by: Zhu, Zhaoqing, et al.
Published: (2025)

Brain-Streams: fMRI-to-Image Reconstruction with Multi-modal Guidance
by: Joo, Jaehoon, et al.
Published: (2024)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection
by: Hao, Chao, et al.
Published: (2024)

CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation
by: Lee, Jungsoo, et al.
Published: (2025)

Identity Decoupling for Multi-Subject Personalization of Text-to-Image Models
by: Jang, Sangwon, et al.
Published: (2024)

FIND: A Simple yet Effective Baseline for Diffusion-Generated Image Detection
by: Li, Jie, et al.
Published: (2026)

Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining
by: Jang, Hyeonseo, et al.
Published: (2026)

Three Heads Are Better Than One: Complementary Experts for Long-Tailed Semi-supervised Learning
by: Ma, Chengcheng, et al.
Published: (2023)

SemiDAViL: Semi-supervised Domain Adaptation with Vision-Language Guidance for Semantic Segmentation
by: Basak, Hritam, et al.
Published: (2025)

Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversation
by: Ki, Taekyung, et al.
Published: (2026)

CubeFormer: A Simple yet Effective Baseline for Lightweight Image Super-Resolution
by: Wang, Jikai, et al.
Published: (2024)

Shifting Spotlight for Co-supervision: A Simple yet Efficient Single-branch Network to See Through Camouflage
by: Hu, Yang, et al.
Published: (2024)

Focusing Where Vision Matters: Selective Training for Large Vision Language Models via Visual Information Gain
by: Lee, Seulbi, et al.
Published: (2026)

Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation
by: Xiao, Hui, et al.
Published: (2024)

Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models
by: Yu, Yu-Chu, et al.
Published: (2024)

Real-Time Shape Tracking of Facial Landmarks
by: Kim, Hyungjoon, et al.
Published: (2018)

Dual-supervised Asymmetric Co-training for Semi-supervised Medical Domain Generalization
by: Song, Jincai, et al.
Published: (2025)

Vision-Language Enhanced Foundation Model for Semi-supervised Medical Image Segmentation
by: Guo, Jiaqi, et al.
Published: (2025)

DINO-Detect: A Simple yet Effective Framework for Blur-Robust AI-Generated Image Detection
by: Shen, Jialiang, et al.
Published: (2025)

Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing
by: Lin, Haonan, et al.
Published: (2024)

Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding
by: Kang, Seil, et al.
Published: (2025)

Distilling Vision-Language Pretraining for Efficient Cross-Modal Retrieval
by: Jang, Young Kyun, et al.
Published: (2024)

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers
by: Bing, Zhaodong, et al.
Published: (2025)

Revisiting Semi-supervised Adversarial Robustness via Noise-aware Online Robust Distillation
by: Wu, Tsung-Han, et al.
Published: (2024)

Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation
by: Yeo, Sangyeop, et al.
Published: (2024)

A Simple yet Effective Test-Time Adaptation for Zero-Shot Monocular Metric Depth Estimation
by: Marsal, Rémi, et al.
Published: (2024)

Identity-Preserving Text-to-Video Generation Guided by Simple yet Effective Spatial-Temporal Decoupled Representations
by: Wang, Yuji, et al.
Published: (2025)