How Instruction and Reasoning Data shape Post-Training: Data Quality through the Lens of Layer-wise Gradients

Documenti analoghi

• What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  di: Li, Ming, et al.
  Pubblicazione: (2024)
• Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  di: Li, Ming, et al.
  Pubblicazione: (2024)
• RuleR: Improving LLM Controllability by Rule-based Data Recycling
  di: Li, Ming, et al.
  Pubblicazione: (2024)
• Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens
  di: Zhao, Chengshuai, et al.
  Pubblicazione: (2025)
• Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?
  di: Fan, Chenrui, et al.
  Pubblicazione: (2025)