Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge

Documenti analoghi

• ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows
  di: Wang, Penghao, et al.
  Pubblicazione: (2025)
• On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention
  di: Ro, Yeonju, et al.
  Pubblicazione: (2025)
• InfoMamba: An Attention-Free Hybrid Mamba-Transformer Model
  di: Wang, Youjin, et al.
  Pubblicazione: (2026)
• Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation
  di: Zhang, Hanrong, et al.
  Pubblicazione: (2025)
• Position: Weight Space Should Be a First-Class Generative AI Modality
  di: Wang, Zhangyang, et al.
  Pubblicazione: (2026)