HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling

Documenti analoghi

• HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment
  di: Jiang, Youhe, et al.
  Pubblicazione: (2025)
• Autopoiesis: A Self-Evolving System Paradigm for LLM Serving Under Runtime Dynamics
  di: Jiang, Youhe, et al.
  Pubblicazione: (2026)
• HexGen: Generative Inference of Large Language Model over Heterogeneous Environment
  di: Jiang, Youhe, et al.
  Pubblicazione: (2023)
• Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs
  di: Jiang, Youhe, et al.
  Pubblicazione: (2025)
• BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
  di: Jiang, Youhe, et al.
  Pubblicazione: (2026)