Cover Image

Multi-Level Decoupled Relational Distillation for Heterogeneous Architectures

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Yaoxin, Ye, Peng, Lin, Weihao, Li, Kangcong, Wen, Yan, Hao, Jia, Chen, Tao
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sequential Token Merging: Revisiting Hidden States
by: Wen, Yan, et al.
Published: (2025)

S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning
by: Lin, Weihao, et al.
Published: (2024)

FreshMem: Brain-Inspired Frequency-Space Hybrid Memory for Streaming Video Understanding
by: Li, Kangcong, et al.
Published: (2026)

SC-Captioner: Improving Image Captioning with Self-Correction by Reinforcement Learning
by: Zhang, Lin, et al.
Published: (2025)

Long-Horizon Streaming Video Generation via Hybrid Attention with Decoupled Distillation
by: Li, Ruibin, et al.
Published: (2026)

CurveStream: Boosting Streaming Video Understanding in MLLMs via Curvature-Aware Hierarchical Visual Memory Management
by: Wang, Chao, et al.
Published: (2026)

Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
by: Tan, Xudong, et al.
Published: (2025)

Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecture
by: Wang, Fei, et al.
Published: (2024)

HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstruction
by: Tang, Shengji, et al.
Published: (2024)

Delving Deep into Semantic Relation Distillation
by: Yan, Zhaoyi, et al.
Published: (2025)

TokenCarve: Information-Preserving Visual Token Compression in Multimodal Large Language Models
by: Tan, Xudong, et al.
Published: (2025)

Enhanced Sparsification via Stimulative Training
by: Tang, Shengji, et al.
Published: (2024)

Revisiting Multimodal KV Cache Compression: A Frequency-Domain-Guided Outlier-KV-Aware Approach
by: Yang, Yaoxin, et al.
Published: (2025)

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation
by: Lin, Jhe-Hao, et al.
Published: (2025)

Decoupled Contrastive Multi-View Clustering with High-Order Random Walks
by: Lu, Yiding, et al.
Published: (2023)

Heterogeneous Complementary Distillation
by: Xu, Liuchi, et al.
Published: (2025)

Prompt Decoupling for Text-to-Image Person Re-identification
by: Li, Weihao, et al.
Published: (2024)

Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation
by: Xiao, Hui, et al.
Published: (2024)

Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
by: Li, Mingcheng, et al.
Published: (2024)

Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures
by: Wu, Hongjun, et al.
Published: (2024)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance
by: Wang, Cunzheng, et al.
Published: (2024)

Beyond the Horizon: Decoupling Multi-View UAV Action Recognition via Partial Order Transfer
by: Liu, Wenxuan, et al.
Published: (2025)

Scale Decoupled Distillation
by: Luo, Shicai Wei Chunbo Luo Yang
Published: (2024)

Revisiting Cross-Architecture Distillation: Adaptive Dual-Teacher Transfer for Lightweight Video Models
by: Peng, Ying, et al.
Published: (2025)

Looking Back and Forth: Cross-Image Attention Calibration and Attentive Preference Learning for Multi-Image Hallucination Mitigation
by: Yang, Xiaochen, et al.
Published: (2026)

Heterogeneous Semantic Transfer for Multi-label Recognition with Partial Labels
by: Chen, Tianshui, et al.
Published: (2022)

Decoupled Hierarchical Distillation for Multimodal Emotion Recognition
by: Li, Yong, et al.
Published: (2026)

Exploring Graph-based Knowledge: Multi-Level Feature Distillation via Channels Relational Graph
by: Wang, Zhiwei, et al.
Published: (2024)

StyDeco: Unsupervised Style Transfer with Distilling Priors and Semantic Decoupling
by: Yang, Yuanlin, et al.
Published: (2025)

Prompt-Anchored Vision-Text Distillation for Lifelong Person Re-identification
by: Wen, Wen, et al.
Published: (2026)

Personalized Face Super-Resolution with Identity Decoupling and Fitting
by: Yang, Jiarui, et al.
Published: (2025)

PRISM: Diversifying Dataset Distillation by Decoupling Architectural Priors
by: Moser, Brian B., et al.
Published: (2025)

Promoting CNNs with Cross-Architecture Knowledge Distillation for Efficient Monocular Depth Estimation
by: Zheng, Zhimeng, et al.
Published: (2024)

CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation
by: Lin, Xiao, et al.
Published: (2025)

HAD: Heterogeneity-Aware Distillation for Lifelong Heterogeneous Learning
by: Zhang, Xuerui, et al.
Published: (2026)

MMA-UNet: A Multi-Modal Asymmetric UNet Architecture for Infrared and Visible Image Fusion
by: Huang, Jingxue, et al.
Published: (2024)

GaitKD: A Universal Decoupled Distillation Framework for Efficient Gait Recognition
by: Li, Yuqi, et al.
Published: (2026)

RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion
by: Huang, Jianxin, et al.
Published: (2024)

Expandable Residual Approximation for Knowledge Distillation
by: Yan, Zhaoyi, et al.
Published: (2025)