FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation

Documenti analoghi

• Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models
  di: Das, Rocktim Jyoti, et al.
  Pubblicazione: (2023)
• DB-LLM: Accurate Dual-Binarization for Efficient LLMs
  di: Chen, Hong, et al.
  Pubblicazione: (2024)
• Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
  di: Liu, Mingjie, et al.
  Pubblicazione: (2025)
• DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
  di: Chen, Jennifer, et al.
  Pubblicazione: (2025)
• Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
  di: Bsharat, Sondos Mahmoud, et al.
  Pubblicazione: (2025)