SpectralKD: A Unified Framework for Interpreting and Distilling Vision Transformers via Spectral Analysis

Documenti analoghi

• Distillation Dynamics: Towards Understanding Feature-Based Distillation in Vision Transformers
  di: Tian, Huiyuan, et al.
  Pubblicazione: (2025)
• From Per-Image Low-Rank to Encoding Mismatch: Rethinking Feature Distillation in Vision Transformers
  di: Tian, Huiyuan, et al.
  Pubblicazione: (2025)
• LIB-KD: Teaching Inductive Bias for Efficient Vision Transformer Distillation and Compression
  di: Habib, Gousia, et al.
  Pubblicazione: (2023)
• HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss
  di: Matin, Abdul, et al.
  Pubblicazione: (2025)
• Understanding Dataset Distillation via Spectral Filtering
  di: Bo, Deyu, et al.
  Pubblicazione: (2025)