Performance Characterization of Expert Router for Scalable LLM Inference

Documenti analoghi

• Harnessing Chain-of-Thought Metadata for Task Routing and Adversarial Prompt Detection
  di: Marinelli, Ryan, et al.
  Pubblicazione: (2025)
• Assessment of RAG and Fine-Tuning for Industrial Question-Answering-Applications
  di: Sturm, Jakob, et al.
  Pubblicazione: (2026)
• DyLLM: Efficient Diffusion LLM Inference via Saliency-based Token Selection and Partial Attention
  di: Lee, Younjoo, et al.
  Pubblicazione: (2026)
• A Data-driven ML Approach for Maximizing Performance in LLM-Adapter Serving
  di: Agullo, Ferran, et al.
  Pubblicazione: (2025)
• Bench360: Benchmarking Local LLM Inference from 360 Degrees
  di: Stuhlmann, Linus, et al.
  Pubblicazione: (2025)