PaD: Program-aided Distillation Can Teach Small Models Reasoning Better than Chain-of-thought Fine-tuning

Documenti analoghi

• Critical Data Size of Language Models from a Grokking Perspective
  di: Zhu, Xuekai, et al.
  Pubblicazione: (2024)
• Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines
  di: Long, Xinwei, et al.
  Pubblicazione: (2025)
• Towards Building Specialized Generalist AI with System 1 and System 2 Fusion
  di: Zhang, Kaiyan, et al.
  Pubblicazione: (2024)
• CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following
  di: Zhang, Kaiyan, et al.
  Pubblicazione: (2024)
• Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  di: Hua, Ermo, et al.
  Pubblicazione: (2024)