Cover Image

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Load Balancing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jain, Kunal, Parayil, Anjaly, Mallick, Ankur, Choukse, Esha, Qin, Xiaoting, Zhang, Jue, Goiri, Íñigo, Wang, Rujia, Bansal, Chetan, Rühle, Victor, Kulkarni, Anoop, Kofsky, Steve, Rajmohan, Saravan
Format: Preprint
Published: 2024
Subjects:
Distributed, Parallel, and Cluster Computing
Systems and Control
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Description not available.

Similar Items