Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference

Documenti analoghi

• DUMP: Automated Distribution-Level Curriculum Learning for RL-based LLM Post-training
  di: Wang, Zhenting, et al.
  Pubblicazione: (2025)
• Deterministic Inference across Tensor Parallel Sizes That Eliminates Training-Inference Mismatch
  di: Zhang, Ziyang, et al.
  Pubblicazione: (2025)
• Efficient Self-Improvement in Multimodal Large Language Models: A Model-Level Judge-Free Approach
  di: Deng, Shijian, et al.
  Pubblicazione: (2024)
• EPO: Entropy-regularized Policy Optimization for LLM Agents Reinforcement Learning
  di: Xu, Wujiang, et al.
  Pubblicazione: (2025)
• DiFR: Inference Verification Despite Nondeterminism
  di: Karvonen, Adam, et al.
  Pubblicazione: (2025)