Adaptively Robust LLM Inference Optimization under Prediction Uncertainty

Documenti analoghi

• LLM Serving Optimization with Variable Prefill and Decode Lengths
  di: Wang, Meixuan, et al.
  Pubblicazione: (2025)
• A Queueing-Theoretic Framework for Stability Analysis of LLM Inference with KV Cache Memory Constraints
  di: Nie, Chengyi, et al.
  Pubblicazione: (2026)
• Online Scheduling for LLM Inference with KV Cache Constraints
  di: Jaillet, Patrick, et al.
  Pubblicazione: (2025)
• DR-SAC: Distributionally Robust Soft Actor-Critic for Reinforcement Learning under Uncertainty
  di: Cui, Mingxuan, et al.
  Pubblicazione: (2025)
• Robust Control with Gradient Uncertainty
  di: Qi, Qian
  Pubblicazione: (2025)