:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Tian, Huiyuan, Xu, Bonan, Li, Shijian, Pan, Gang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	https://arxiv.org/abs/2412.19055
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Distillation Dynamics: Towards Understanding Feature-Based Distillation in Vision Transformers
by: Tian, Huiyuan, et al.
Published: (2025)

From Per-Image Low-Rank to Encoding Mismatch: Rethinking Feature Distillation in Vision Transformers
by: Tian, Huiyuan, et al.
Published: (2025)

LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression
by: Habib, Gousia, et al.
Published: (2023)

HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss
by: Matin, Abdul, et al.
Published: (2025)

Understanding Dataset Distillation via Spectral Filtering
by: Bo, Deyu, et al.
Published: (2025)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
by: Lo, Ka Man, et al.
Published: (2024)

ScaleKD: Strong Vision Transformers Could Be Excellent Teachers
by: Fan, Jiawei, et al.
Published: (2024)

SAFE-KD: Risk-Controlled Early-Exit Distillation for Vision Backbones
by: Khazem, Salim
Published: (2026)

Spectral Gradient Surgery for Domain-Generalizable Dataset Distillation
by: Oh, Minyoung, et al.
Published: (2026)

Weight Averaging for Out-of-Distribution Generalization and Few-Shot Domain Adaptation
by: Xu, Shijian
Published: (2025)

Deep Spectral Clustering via Joint Spectral Embedding and Kmeans
by: Guo, Wengang, et al.
Published: (2024)

SPA++: Generalized Graph Spectral Alignment for Versatile Domain Adaptation
by: Xiao, Zhiqing, et al.
Published: (2025)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
by: Kim, Hyungmin, et al.
Published: (2022)

Schrodinger AI: A Unified Spectral-Dynamical Framework for Classification, Reasoning, and Operator-Based Generalization
by: Nguyen, Truong Son
Published: (2025)

ResiDual Transformer Alignment with Spectral Decomposition
by: Basile, Lorenzo, et al.
Published: (2024)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
by: Tang, Zihao, et al.
Published: (2024)

Multi-Depth Branch Network for Efficient Image Super-Resolution
by: Tian, Huiyuan, et al.
Published: (2023)

Domain-Enhanced Dual-Branch Model for Efficient and Interpretable Accident Anticipation
by: Guan, Yanchen, et al.
Published: (2025)

Protego: Detecting Adversarial Examples for Vision Transformers via Intrinsic Capabilities
by: Wu, Jialin, et al.
Published: (2025)

GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation
by: Banerjee, Ayan, et al.
Published: (2024)

Hyperspectral Image Spectral-Spatial Feature Extraction via Tensor Principal Component Analysis
by: Ren, Yuemei, et al.
Published: (2024)

Spectral-Spatial Contrastive Learning Framework for Regression on Hyperspectral Data
by: Dhaini, Mohamad, et al.
Published: (2026)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
by: Son, Seungwoo, et al.
Published: (2023)

DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
by: Huang, Haiduo, et al.
Published: (2025)

Latent Danger Zone: Distilling Unified Attention for Cross-Architecture Black-box Attacks
by: Li, Yang, et al.
Published: (2025)

Spectral Image Tokenizer
by: Esteves, Carlos, et al.
Published: (2024)

DisCoM-KD: Cross-Modal Knowledge Distillation via Disentanglement Representation and Adversarial Learning
by: Ienco, Dino, et al.
Published: (2024)

Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Sampling
by: Mekonnen, Kidist Amde, et al.
Published: (2024)

KD-OCT: Efficient Knowledge Distillation for Clinical-Grade Retinal OCT Classification
by: Nourbakhsh, Erfan, et al.
Published: (2025)

Clustering-Guided Spatial-Spectral Mamba for Hyperspectral Image Classification
by: Dewis, Zack, et al.
Published: (2026)

Improving Interpretation Faithfulness for Vision Transformers
by: Hu, Lijie, et al.
Published: (2023)

VL-SAE: Interpreting and Enhancing Vision-Language Alignment with a Unified Concept Set
by: Shen, Shufan, et al.
Published: (2025)

Brain-CLIPLM: Decoding Compressed Semantic Representations in EEG for Language Reconstruction
by: Yang, Xiaoli, et al.
Published: (2026)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
by: Wang, Yu, et al.
Published: (2022)

SpectralAR: Spectral Autoregressive Visual Generation
by: Huang, Yuanhui, et al.
Published: (2025)

Spectrally-Guided Diffusion Noise Schedules
by: Esteves, Carlos, et al.
Published: (2026)

Towards Improved Cervical Cancer Screening: Vision Transformer-Based Classification and Interpretability
by: Nguyen, Khoa Tuan, et al.
Published: (2025)

Adaptive Spectral Feature Forecasting for Diffusion Sampling Acceleration
by: Han, Jiaqi, et al.
Published: (2026)

FerKD: Surgical Label Adaptation for Efficient Distillation
by: Shen, Zhiqiang
Published: (2023)

Transformation of Biological Networks into Images via Semantic Cartography for Visual Interpretation and Scalable Deep Analysis
by: Mostafa, Sakib, et al.
Published: (2025)