Cover Image

Soft Knowledge Distillation with Multi-Dimensional Cross-Net Attention for Image Restoration Models Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Yongheng, Yan, Danfeng
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images
by: Zhang, Yongheng, et al.
Published: (2025)

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
by: Zhou, Yunshuai, et al.
Published: (2024)

Channel Attention-Guided Cross-Modal Knowledge Distillation for Referring Image Segmentation
by: Yang, Chen
Published: (2026)

Compressing Multi-Task Model for Autonomous Driving via Pruning and Knowledge Distillation
by: Wang, Jiayuan, et al.
Published: (2025)

Efficient Learned Image Compression Through Knowledge Distillation
by: Allemand, Fabien, et al.
Published: (2025)

Soft-Hard Attention U-Net Model and Benchmark Dataset for Multiscale Image Shadow Removal
by: Cholopoulou, Eirini, et al.
Published: (2024)

Vector-Quantized Soft Label Compression for Dataset Distillation
by: Abbasi, Ali, et al.
Published: (2026)

ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical Images
by: Ge, Hongyu, et al.
Published: (2025)

Semi-supervised Semantic Segmentation for Remote Sensing Images via Multi-scale Uncertainty Consistency and Cross-Teacher-Student Attention
by: Wang, Shanwen, et al.
Published: (2025)

Frequency Attention for Knowledge Distillation
by: Pham, Cuong, et al.
Published: (2024)

Large-Scale Data-Free Knowledge Distillation for ImageNet via Multi-Resolution Data Generation
by: Tran, Minh-Tuan, et al.
Published: (2024)

Attention Fusion Reverse Distillation for Multi-Lighting Image Anomaly Detection
by: Zhang, Yiheng, et al.
Published: (2024)

Distilling Semantic Priors from SAM to Efficient Image Restoration Models
by: Zhang, Quan, et al.
Published: (2024)

MA-LipNet: Multi-Dimensional Attention Networks for Robust Lipreading
by: Rossi, Matteo
Published: (2026)

All-in-One Image Compression and Restoration
by: Zeng, Huimin, et al.
Published: (2025)

Pathryoshka: Compressing Pathology Foundation Models via Multi-Teacher Knowledge Distillation with Nested Embeddings
by: Grashei, Christian, et al.
Published: (2025)

UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillation
by: Yang, Runzhao, et al.
Published: (2024)

Multi-Dataset Cross-Domain Knowledge Distillation for Unified Medical Image Segmentation, Classification, and Detection
by: Ciprian-Mihai, Ceausescu, et al.
Published: (2026)

CSAKD: Knowledge Distillation with Cross Self-Attention for Hyperspectral and Multispectral Image Fusion
by: Hsu, Chih-Chung, et al.
Published: (2024)

Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration
by: Wang, Pei, et al.
Published: (2024)

Hierarchical Semantic Compression for Consistent Image Semantic Restoration
by: Li, Shengxi, et al.
Published: (2025)

Decoder-Free Distillation for Quantized Image Restoration
by: Sharif, S. M. A., et al.
Published: (2026)

HAT: Hybrid Attention Transformer for Image Restoration
by: Chen, Xiangyu, et al.
Published: (2023)

Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
by: Qiao, Bingtian, et al.
Published: (2026)

InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention
by: Zhang, Howard, et al.
Published: (2024)

Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models
by: Miriyala, Srinivas Soumitri, et al.
Published: (2026)

Cross-View Consistency Regularisation for Knowledge Distillation
by: Zhang, Weijia, et al.
Published: (2024)

Linear Attention Modeling for Learned Image Compression
by: Feng, Donghui, et al.
Published: (2025)

HMID-Net: An Exploration of Masked Image Modeling and Knowledge Distillation in Hyperbolic Space
by: Wang, Changli, et al.
Published: (2025)

CanKD: Cross-Attention-based Non-local operation for Feature-based Knowledge Distillation
by: Sun, Shizhe, et al.
Published: (2025)

MAVR-Net: Robust Multi-View Learning for MAV Action Recognition with Cross-View Attention
by: Zhang, Nengbo, et al.
Published: (2025)

Expandable, Compressible, Mineable: Open-World Thermal Image Restoration
by: Li, Pu, et al.
Published: (2026)

Parallax to Align Them All: An OmniParallax Attention Mechanism for Distributed Multi-View Image Compression
by: Zhang, Haotian, et al.
Published: (2026)

Knowledge Distillation with Multi-granularity Mixture of Priors for Image Super-Resolution
by: Li, Simiao, et al.
Published: (2024)

Distribution-aware Dataset Distillation for Efficient Image Restoration
by: Zheng, Zhuoran, et al.
Published: (2025)

BookNet: Book Image Rectification via Cross-Page Attention Network
by: Liu, Shaokai, et al.
Published: (2026)

PromptCIR: Blind Compressed Image Restoration with Prompt Learning
by: Li, Bingchen, et al.
Published: (2024)

Bidirectional Stereo Image Compression with Cross-Dimensional Entropy Model
by: Liu, Zhening, et al.
Published: (2024)

How Powerful Potential of Attention on Image Restoration?
by: Wang, Cong, et al.
Published: (2024)

A Preliminary Study on GPT-Image Generation Model for Image Restoration
by: Yang, Hao, et al.
Published: (2025)