Cover Image

Harmonizing knowledge Transfer in Neural Network with Unified Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Yaomin, Yan, Zaomin, Shen, Chaomin, Fang, Faming, Zhang, Guixu
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
by: Shen, Chaomin, et al.
Published: (2024)

Deep Unfolding Convolutional Dictionary Model for Multi-Contrast MRI Super-resolution and Reconstruction
by: Lei, Pengcheng, et al.
Published: (2023)

First-order State Space Model for Lightweight Image Super-resolution
by: Zhu, Yujie, et al.
Published: (2025)

Mamba-Based Modality Disentanglement Network for Multi-Contrast MRI Reconstruction
by: Lyu, Weiyi, et al.
Published: (2025)

Monocular Depth Estimation with Global-Aware Discretization and Local Context Modeling
by: Wu, Heng, et al.
Published: (2025)

Attention Distillation: A Unified Approach to Visual Characteristics Transfer
by: Zhou, Yang, et al.
Published: (2025)

Efficient Feature Fusion for UAV Object Detection
by: Wang, Xudong, et al.
Published: (2025)

Frequency Error-Guided Under-sampling Optimization for Multi-Contrast MRI Reconstruction
by: Fang, Xinming, et al.
Published: (2026)

QMoP: Query Guided Mixture-of-Projector for Efficient Visual Token Compression
by: Li, Zhongyang, et al.
Published: (2026)

A-MESS: Anchor based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognition
by: Shen, Yaomin, et al.
Published: (2025)

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks
by: Wang, Ziqing, et al.
Published: (2023)

Harmonizing Visual Representations for Unified Multimodal Understanding and Generation
by: Wu, Size, et al.
Published: (2025)

Neural Spectral Decomposition for Dataset Distillation
by: Yang, Shaolei, et al.
Published: (2024)

Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance
by: Ji, Xiang, et al.
Published: (2026)

A Novel Garment Transfer Method Supervised by Distilled Knowledge of Virtual Try-on Model
by: Fang, Naiyu, et al.
Published: (2024)

Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2025)

Two-Way Garment Transfer: Unified Diffusion Framework for Dressing and Undressing Synthesis
by: Zhang, Angang, et al.
Published: (2025)

Style Transfer: From Stitching to Neural Networks
by: Xu, Xinhe, et al.
Published: (2024)

WPT: World-to-Policy Transfer via Online World Model Distillation
by: Jiang, Guangfeng, et al.
Published: (2025)

Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment
by: Huang, Tengjun
Published: (2024)

Fully Spiking Neural Networks for Unified Frame-Event Object Tracking
by: Yang, Jingjun, et al.
Published: (2025)

An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain
by: He, Xiang, et al.
Published: (2023)

Memory-Efficient Transfer Learning with Fading Side Networks via Masked Dual Path Distillation
by: Zhang, Yutong, et al.
Published: (2026)

HYDRA: Unifying Multi-modal Generation and Understanding via Representation-Harmonized Tokenization
by: Qiu, Xuerui, et al.
Published: (2026)

Dropping Anchor and Spherical Harmonics for Sparse-view Gaussian Splatting
by: Fang, Shuangkang, et al.
Published: (2026)

Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural Networks
by: Zhong, Xian, et al.
Published: (2024)

Neural Collapse Inspired Knowledge Distillation
by: Zhang, Shuoxi, et al.
Published: (2024)

Generative Denoise Distillation: Simple Stochastic Noises Induce Efficient Knowledge Transfer for Dense Prediction
by: Liu, Zhaoge, et al.
Published: (2024)

InDistill: Information flow-preserving knowledge distillation for model compression
by: Sarridis, Ioannis, et al.
Published: (2022)

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network
by: Wang, Ziqing, et al.
Published: (2024)

Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval
by: Sun, Hao, et al.
Published: (2026)

Sampling to Distill: Knowledge Transfer from Open-World Data
by: Wang, Yuzheng, et al.
Published: (2023)

Fresh-CL: Feature Realignment through Experts on Hypersphere in Continual Learning
by: Zhou, Zhongyi, et al.
Published: (2025)

Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training
by: Zhao, Xiaochen, et al.
Published: (2025)

The Prism Hypothesis: Harmonizing Semantic and Pixel Representations via Unified Autoencoding
by: Fan, Weichen, et al.
Published: (2025)

DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control
by: Wen, Junjie, et al.
Published: (2025)

Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression
by: Schmitt, Jonas, et al.
Published: (2024)

A Unified Framework for Stealthy Adversarial Generation via Latent Optimization and Transferability Enhancement
by: Pei, Gaozheng, et al.
Published: (2025)

VDOT: Efficient Unified Video Creation via Optimal Transport Distillation
by: Wang, Yutong, et al.
Published: (2025)

MetaDD: Boosting Dataset Distillation with Neural Network Architecture-Invariant Generalization
by: Zhao, Yunlong, et al.
Published: (2024)