Scalable LLM Reasoning Acceleration with Low-rank Distillation

Documenti analoghi

• Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
  di: Dong, Harry, et al.
  Pubblicazione: (2024)
• Low-rank Optimization Trajectories Modeling for LLM RLVR Acceleration
  di: Chen, Zhipeng, et al.
  Pubblicazione: (2026)
• Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
  di: Dong, Harry, et al.
  Pubblicazione: (2024)
• LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
  di: Elhoushi, Mostafa, et al.
  Pubblicazione: (2024)
• LoRe: Personalizing LLMs via Low-Rank Reward Modeling
  di: Bose, Avinandan, et al.
  Pubblicazione: (2025)