An Analysis for Reasoning Bias of Language Models with Small Initialization

Documenti analoghi

• Reasoning Bias of Next Token Prediction Training
  di: Lin, Pengxiao, et al.
  Pubblicazione: (2025)
• Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers
  di: Zhang, Zhongwang, et al.
  Pubblicazione: (2025)
• Anchor function: a type of benchmark functions for studying language models
  di: Zhang, Zhongwang, et al.
  Pubblicazione: (2024)
• Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism
  di: Wang, Zhiwei, et al.
  Pubblicazione: (2024)
• Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing
  di: Zhang, Zhongwang, et al.
  Pubblicazione: (2024)