Harli: SLO-Aware Co-location of LLM Inference and PEFT-based Finetuning on Model-as-a-Service Platforms

Documenti analoghi

• MuxTune: Efficient Multi-Task LLM Fine-Tuning in Multi-Tenant Datacenters via Spatial-Temporal Backbone Multiplexing
  di: Xue, Chunyu, et al.
  Pubblicazione: (2026)
• S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance
  di: Liu, Di, et al.
  Pubblicazione: (2026)
• Towards Fast Setup and High Throughput of GPU Serverless Computing
  di: Zhao, Han, et al.
  Pubblicazione: (2024)
• SLO-Aware Scheduling for Large Language Model Inferences
  di: Huang, Jinqi, et al.
  Pubblicazione: (2025)
• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)