Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining

Documenti analoghi

• Long-Short Alignment for Effective Long-Context Modeling in LLMs
  di: Du, Tianqi, et al.
  Pubblicazione: (2025)
• A Theoretical Understanding of Self-Correction through In-context Alignment
  di: Wang, Yifei, et al.
  Pubblicazione: (2024)
• When More is Less: Understanding Chain-of-Thought Length in LLMs
  di: Wu, Yuyang, et al.
  Pubblicazione: (2025)
• Advancing LLM Safe Alignment with Safety Representation Ranking
  di: Du, Tianqi, et al.
  Pubblicazione: (2025)
• On the Role of Discrete Tokenization in Visual Representation Learning
  di: Du, Tianqi, et al.
  Pubblicazione: (2024)