Cover Image

Asymmetric Decision-Making in Online Knowledge Distillation:Unifying Consensus and Divergence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Zhaowei, Zhao, Borui, Ge, Yuchen, Chen, Yuhao, Song, Renjie, Liang, Jiajun
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Models
by: Zhang, Shen, et al.
Published: (2023)

Balance Divergence for Knowledge Distillation
by: Qi, Yafei, et al.
Published: (2025)

BD-KD: Balancing the Divergences for Online Knowledge Distillation
by: Amara, Ibtihel, et al.
Published: (2022)

LEDiT: Your Length-Extrapolatable Diffusion Transformer without Positional Encoding
by: Zhang, Shen, et al.
Published: (2025)

Efficient Temporal Sentence Grounding in Videos with Multi-Teacher Knowledge Distillation
by: Liang, Renjie, et al.
Published: (2023)

Revisiting Prompt Pretraining of Vision-Language Models
by: Chen, Zhenyuan, et al.
Published: (2024)

Cascade Prompt Learning for Vision-Language Model Adaptation
by: Wu, Ge, et al.
Published: (2024)

Non-target Divergence Hypothesis: Toward Understanding Domain Gaps in Cross-Modal Knowledge Distillation
by: Chen, Yilong, et al.
Published: (2024)

Optimizing Knowledge Distillation in Transformers: Enabling Multi-Head Attention without Alignment Barriers
by: Bing, Zhaodong, et al.
Published: (2025)

DIVA: Harnessing the Representation Divergence in Unified Multimodal Models for Mutual Reinforcement
by: Lu, Renjie, et al.
Published: (2026)

Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
by: Shu, Chen, et al.
Published: (2025)

Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking
by: Yang, Hongtao, et al.
Published: (2026)

Knowledge Distillation with Refined Logits
by: Sun, Wujie, et al.
Published: (2024)

What Makes a Good Dataset for Knowledge Distillation?
by: Frank, Logan, et al.
Published: (2024)

MK-SGN: A Spiking Graph Convolutional Network with Multimodal Fusion and Knowledge Distillation for Skeleton-based Action Recognition
by: Zheng, Naichuan, et al.
Published: (2024)

Hybrid Data-Free Knowledge Distillation
by: Tang, Jialiang, et al.
Published: (2024)

Asymmetric Cross-Modal Knowledge Distillation: Bridging Modalities with Weak Semantic Consistency
by: Wei, Riling, et al.
Published: (2025)

Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation
by: Qiu, Shoumeng, et al.
Published: (2024)

Triple-View Knowledge Distillation for Semi-Supervised Semantic Segmentation
by: Li, Ping, et al.
Published: (2023)

Multi-modal Knowledge Decomposition based Online Distillation for Biomarker Prediction in Breast Cancer Histopathology
by: Zhang, Qibin, et al.
Published: (2025)

Neural Collapse Inspired Knowledge Distillation
by: Zhang, Shuoxi, et al.
Published: (2024)

Expandable Residual Approximation for Knowledge Distillation
by: Yan, Zhaoyi, et al.
Published: (2025)

Sampling to Distill: Knowledge Transfer from Open-World Data
by: Wang, Yuzheng, et al.
Published: (2023)

Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
by: Chen, Chenglizhao, et al.
Published: (2026)

CAPO: Reinforcing Consistent Reasoning in Medical Decision-Making
by: Jiang, Songtao, et al.
Published: (2025)

Asymmetric Masked Distillation for Pre-Training Small Foundation Models
by: Zhao, Zhiyu, et al.
Published: (2023)

Making Large Language Models Better Planners with Reasoning-Decision Alignment
by: Huang, Zhijian, et al.
Published: (2024)

SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation
by: Ge, Yuying, et al.
Published: (2024)

World-Shaper: A Unified Framework for 360° Panoramic Editing
by: Liang, Dong, et al.
Published: (2026)

LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation
by: Shu, Fangxun, et al.
Published: (2024)

Part-Attention Based Model Make Occluded Person Re-Identification Stronger
by: Chen, Zhihao, et al.
Published: (2024)

EA-KD: Entropy-based Adaptive Knowledge Distillation
by: Su, Chi-Ping, et al.
Published: (2023)

Dual-supervised Asymmetric Co-training for Semi-supervised Medical Domain Generalization
by: Song, Jincai, et al.
Published: (2025)

A Cross-Domain Few-Shot Learning Method Based on Domain Knowledge Mapping
by: Chen, Jiajun, et al.
Published: (2025)

Attention Distillation: A Unified Approach to Visual Characteristics Transfer
by: Zhou, Yang, et al.
Published: (2025)

MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
by: Khan, Hikmat, et al.
Published: (2026)

HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation
by: Zhang, Sha, et al.
Published: (2024)

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector
by: Ma, Shuailei, et al.
Published: (2023)

Channel Attention-Guided Cross-Modal Knowledge Distillation for Referring Image Segmentation
by: Yang, Chen
Published: (2026)

PaintFlow: A Unified Framework for Interactive Oil Paintings Editing and Generation
by: Hu, Zhangli, et al.
Published: (2025)