Cover Image

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Guopeng, Wang, Qiang, Yan, Ke, Ding, Shouhong, Gao, Yuan, Xia, Gui-Song
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LaRE$^2$: Latent Reconstruction Error Based Method for Diffusion-Generated Image Detection
by: Luo, Yunpeng, et al.
Published: (2024)

Heterogeneous Generative Knowledge Distillation with Masked Image Modeling
by: Wang, Ziming, et al.
Published: (2023)

Adaptive Explicit Knowledge Transfer for Knowledge Distillation
by: Park, Hyungkeun, et al.
Published: (2024)

VISA: Group-wise Visual Token Selection and Aggregation via Graph Summarization for Efficient MLLMs Inference
by: Jiang, Pengfei, et al.
Published: (2025)

Towards Effective Data-Free Knowledge Distillation via Diverse Diffusion Augmentation
by: Li, Muquan, et al.
Published: (2024)

Dual Relation Mining Network for Zero-Shot Learning
by: Han, Jinwei, et al.
Published: (2024)

MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Training
by: Li, Jiayang, et al.
Published: (2024)

ToVE: Efficient Vision-Language Learning via Knowledge Transfer from Vision Experts
by: Wu, Yuanchen, et al.
Published: (2025)

Look Before You Fuse: 2D-Guided Cross-Modal Alignment for Robust 3D Detection
by: Li, Xiang, et al.
Published: (2025)

FusionFM: Fusing Eye-specific Foundational Models for Optimized Ophthalmic Diagnosis
by: Zou, Ke, et al.
Published: (2025)

All You Need in Knowledge Distillation Is a Tailored Coordinate System
by: Zhou, Junjie, et al.
Published: (2024)

DAE-Fuse: An Adaptive Discriminative Autoencoder for Multi-Modality Image Fusion
by: Guo, Yuchen, et al.
Published: (2024)

GateFuseNet: An Adaptive 3D Multimodal Neuroimaging Fusion Network for Parkinson's Disease Diagnosis
by: Jin, Rui, et al.
Published: (2025)

Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-Distillation
by: Yan, Xu, et al.
Published: (2026)

Decoupled Data Augmentation for Improving Image Classification
by: Chen, Ruoxin, et al.
Published: (2024)

FusionSF: Fuse Heterogeneous Modalities in a Vector Quantized Framework for Robust Solar Power Forecasting
by: Ma, Ziqing, et al.
Published: (2024)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generation
by: Li, Yuejia, et al.
Published: (2026)

MicroAUNet: Boundary-Enhanced Multi-scale Fusion with Knowledge Distillation for Colonoscopy Polyp Image Segmentation
by: Wang, Ziyi, et al.
Published: (2025)

Energy Score-based Pseudo-Label Filtering and Adaptive Loss for Imbalanced Semi-supervised SAR target recognition
by: Zhang, Xinzheng, et al.
Published: (2024)

Robust MLLM Unlearning via Visual Knowledge Distillation
by: Wang, Yuhang, et al.
Published: (2025)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

Dual-Student Knowledge Distillation Networks for Unsupervised Anomaly Detection
by: Yao, Liyi, et al.
Published: (2024)

Anchor-based Robust Finetuning of Vision-Language Models
by: Han, Jinwei, et al.
Published: (2024)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

FuseUNet: A Multi-Scale Feature Fusion Method for U-like Networks
by: He, Quansong, et al.
Published: (2025)

Distilling Cross-Modal Knowledge via Feature Disentanglement
by: Liu, Junhong, et al.
Published: (2025)

Improving Fast Adversarial Training via Self-Knowledge Guidance
by: Jiang, Chengze, et al.
Published: (2024)

Multi-Level Heterogeneous Knowledge Transfer Network on Forward Scattering Center Model for Limited Samples SAR ATR
by: Zhao, Chenxi, et al.
Published: (2025)

DMTG: One-Shot Differentiable Multi-Task Grouping
by: Gao, Yuan, et al.
Published: (2024)

Data Upcycling Knowledge Distillation for Image Super-Resolution
by: Zhang, Yun, et al.
Published: (2023)

Simple Unsupervised Knowledge Distillation With Space Similarity
by: Singh, Aditya, et al.
Published: (2024)

Bridging Weakly-Supervised Learning and VLM Distillation: Noisy Partial Label Learning for Efficient Downstream Adaptation
by: Wang, Qian-Wei, et al.
Published: (2025)

AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment
by: Chen, Ruoxin, et al.
Published: (2025)

Dual-Stream Spectral Decoupling Distillation for Remote Sensing Object Detection
by: Gao, Xiangyi, et al.
Published: (2025)

Res2NetFuse: A Novel Res2Net-based Fusion Method for Infrared and Visible Images
by: Song, Xu, et al.
Published: (2021)

AdaFuse: Adaptive Multimodal Fusion for Lung Cancer Risk Prediction via Reinforcement Learning
by: Qu, Chongyu, et al.
Published: (2026)

Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image
by: Qian, Ming, et al.
Published: (2026)

A Heterogeneous Graph Neural Network Fusing Functional and Structural Connectivity for MCI Diagnosis
by: Yin, Feiyu, et al.
Published: (2024)

Unleashing Unlabeled Data: A Paradigm for Cross-View Geo-Localization
by: Li, Guopeng, et al.
Published: (2024)