Cover Image

Cross-Architecture Distillation Made Simple with Redundancy Suppression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Weijia, Liu, Yuehao, Ran, Wu, Ma, Chao
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Cross-View Consistency Regularisation for Knowledge Distillation
by: Zhang, Weijia, et al.
Published: (2024)

Guiding a Diffusion Model by Swapping Its Tokens
by: Zhang, Weijia, et al.
Published: (2026)

VRM: Knowledge Distillation via Virtual Relation Matching
by: Zhang, Weijia, et al.
Published: (2025)

ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
by: Liu, Yuehao, et al.
Published: (2026)

Multimodal Dataset Distillation Made Simple by Prototype-Guided Data Synthesis
by: Choi, Junhyeok, et al.
Published: (2026)

Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models
by: Liu, Yuehao, et al.
Published: (2026)

CP-VoteNet: Contrastive Prototypical VoteNet for Few-Shot Point Cloud Object Detection
by: Li, Xuejing, et al.
Published: (2024)

Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose
by: Liu, Yingcheng, et al.
Published: (2025)

Color-Oriented Redundancy Reduction in Dataset Distillation
by: Yuan, Bowen, et al.
Published: (2024)

Face Anonymization Made Simple
by: Kung, Han-Wei, et al.
Published: (2024)

X-Distill: Cross-Architecture Vision Distillation for Visuomotor Learning
by: Shao, Maanping, et al.
Published: (2026)

QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model
by: Xie, Fei, et al.
Published: (2024)

CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation
by: Govindarajan, Hariprasath, et al.
Published: (2025)

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector
by: Ma, Shuailei, et al.
Published: (2023)

Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferability
by: Liu, Jiani, et al.
Published: (2025)

MV-Adapter: Multi-view Consistent Image Generation Made Easy
by: Huang, Zehuan, et al.
Published: (2024)

Improve Cross-Architecture Generalization on Dataset Distillation
by: Zhou, Binglin, et al.
Published: (2024)

Simple and Fast Distillation of Diffusion Models
by: Zhou, Zhenyu, et al.
Published: (2024)

Promoting CNNs with Cross-Architecture Knowledge Distillation for Efficient Monocular Depth Estimation
by: Zheng, Zhimeng, et al.
Published: (2024)

Cross-View Localization via Redundant Sliced Observations and A-Contrario Validation
by: Zhang, Yongjun, et al.
Published: (2025)

Revisiting Cross-Architecture Distillation: Adaptive Dual-Teacher Transfer for Lightweight Video Models
by: Peng, Ying, et al.
Published: (2025)

SWARD: Stochastic Window-Attention-Based Relational Distillation for Cross-Architectural Semantic Segmentation
by: Makineni, Aditya, et al.
Published: (2026)

Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation
by: Liu, Xiaoyan, et al.
Published: (2025)

Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures
by: Wu, Hongjun, et al.
Published: (2024)

Streamline Without Sacrifice -- Squeeze out Computation Redundancy in LMM
by: Wu, Penghao, et al.
Published: (2025)

Fusion-then-Distillation: Toward Cross-modal Positive Distillation for Domain Adaptive 3D Semantic Segmentation
by: Wu, Yao, et al.
Published: (2024)

Distilling Textual Priors from LLM to Efficient Image Fusion
by: Zhang, Ran, et al.
Published: (2025)

AnyDepth: Depth Estimation Made Easy
by: Ren, Zeyu, et al.
Published: (2026)

Active Multimodal Distillation for Few-shot Action Recognition
by: Feng, Weijia, et al.
Published: (2025)

DeltaMIL: Gated Memory Integration for Efficient and Discriminative Whole Slide Image Analysis
by: Zhu, Yueting, et al.
Published: (2025)

FastVMT: Eliminating Redundancy in Video Motion Transfer
by: Ma, Yue, et al.
Published: (2026)

EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing
by: Yan, Zexuan, et al.
Published: (2025)

Hybrid Fusion: One-Minute Efficient Training for Zero-Shot Cross-Domain Image Fusion
by: Zhang, Ran, et al.
Published: (2026)

RedundancyLens: Revealing and Exploiting Visual Token Processing Redundancy for Efficient Decoder-Only MLLMs
by: Li, Hongliang, et al.
Published: (2025)

Efficient Point Cloud Classification via Offline Distillation Framework and Negative-Weight Self-Distillation Technique
by: Zheng, Qiang, et al.
Published: (2024)

Latent Danger Zone: Distilling Unified Attention for Cross-Architecture Black-box Attacks
by: Li, Yang, et al.
Published: (2025)

Asymmetric Cross-Modal Knowledge Distillation: Bridging Modalities with Weak Semantic Consistency
by: Wei, Riling, et al.
Published: (2025)

Short-LVLM: Compressing and Accelerating Large Vision-Language Models by Pruning Redundant Layers
by: Ma, Ji, et al.
Published: (2025)

Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval
by: Li, Jiaxing, et al.
Published: (2025)

Benchmarking Predictive Coding Networks -- Made Simple
by: Pinchetti, Luca, et al.
Published: (2024)