Can You Learn to See Without Images? Procedural Warm-Up for Vision Transformers

Documenti analoghi

• Procedural Pretraining: Warming Up Language Models with Abstract Data
  di: Jiang, Liangze, et al.
  Pubblicazione: (2026)
• Transformers Pretrained on Procedural Data Contain Modular Structures for Algorithmic Reasoning
  di: Shinnick, Zachary, et al.
  Pubblicazione: (2025)
• Leaner Transformers: More Heads, Less Depth
  di: Saratchandran, Hemanth, et al.
  Pubblicazione: (2025)
• Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild
  di: Teney, Damien, et al.
  Pubblicazione: (2025)
• Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product
  di: Albert, Paul, et al.
  Pubblicazione: (2025)