Imagen de Portada

SageSched: Efficient LLM Scheduling Confronting Demand Uncertainty and Hybridity

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gan, Zhenghao, Bao, Yichen, Liu, Yifei, Chen, Chen, Chen, Quan, Guo, Minyi
Formato:	Preprint
Publicado:	2026
Materias:	Distributed, Parallel, and Cluster Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Serving of LLM Applications with Probabilistic Demand Modeling
por: Liu, Yifei, et al.
Publicado: (2025)

S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance
por: Liu, Di, et al.
Publicado: (2026)

PecSched: Preemptive and Efficient Cluster Scheduling for LLM Inference
por: Zhang, Zeyu, et al.
Publicado: (2024)

LLMSched: Uncertainty-Aware Workload Scheduling for Compound LLM Applications
por: Zhu, Botao, et al.
Publicado: (2025)

Towards Resource-Efficient Serverless LLM Inference with SLINFER
por: Xu, Chuhao, et al.
Publicado: (2025)

Justitia: Fair and Efficient Scheduling of Task-parallel LLM Agents with Selective Pampering
por: Yang, Mingyan, et al.
Publicado: (2025)

CALVO: Improve Serving Efficiency for LLM Inferences with Intense Network Demands
por: Wang, Weiye, et al.
Publicado: (2026)

Kairos: Low-latency Multi-Agent Serving with Shared LLMs and Excessive Loads in the Public Cloud
por: Chen, Jinyuan, et al.
Publicado: (2025)

IsoSched: Preemptive Tile Cascaded Scheduling of Multi-DNN via Subgraph Isomorphism
por: Zhao, Boran, et al.
Publicado: (2025)

MuxTune: Efficient Multi-Task LLM Fine-Tuning in Multi-Tenant Datacenters via Spatial-Temporal Backbone Multiplexing
por: Xue, Chunyu, et al.
Publicado: (2026)

AB-Sparse: Sparse Attention with Adaptive Block Size for Accurate and Efficient Long-Context Inference
por: Liu, Di, et al.
Publicado: (2026)

DASH: Deterministic Attention Scheduling for High-throughput Reproducible LLM Training
por: Qiang, Xinwei, et al.
Publicado: (2026)

Efficient Unified Caching for Accelerating Heterogeneous AI Workloads
por: Wang, Tianze, et al.
Publicado: (2025)

TD3-Sched: Learning to Orchestrate Container-based Cloud-Edge Resources via Distributed Reinforcement Learning
por: Song, Shengye, et al.
Publicado: (2025)

Arena: Efficiently Training Large Models via Dynamic Scheduling and Adaptive Parallelism Co-Design
por: Xue, Chunyu, et al.
Publicado: (2024)

GoodServe: Towards High-Goodput Serving of Agentic LLM Inferences over Heterogeneous Resources
por: Du, Boxiao, et al.
Publicado: (2026)

Accelerating Sparse DNNs Based on Tiled GEMM
por: Guo, Cong, et al.
Publicado: (2024)

FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs
por: He, Xuan, et al.
Publicado: (2025)

eLLM: Elastic Memory Management Framework for Efficient LLM Serving
por: Xu, Jiale, et al.
Publicado: (2025)

HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling
por: Peng, You, et al.
Publicado: (2026)

VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference
por: Liu, Zihan, et al.
Publicado: (2025)

SageServe: Optimizing LLM Serving on Cloud Data Centers with Forecast Aware Auto-Scaling
por: Jaiswal, Shashwat, et al.
Publicado: (2025)

Towards Fast Setup and High Throughput of GPU Serverless Computing
por: Zhao, Han, et al.
Publicado: (2024)

Harli: SLO-Aware Co-location of LLM Inference and PEFT-based Finetuning on Model-as-a-Service Platforms
por: Xu, Ao, et al.
Publicado: (2025)

Bandwidth-Aware and Cost-Efficient Pipeline Parallel Scheduling in Geo-Distributed LLM Training
por: Zhang, Han, et al.
Publicado: (2026)

Hyperion: Hierarchical Scheduling for Parallel LLM Acceleration in Multi-tier Networks
por: Ma, Mulei, et al.
Publicado: (2025)

A Predictive and Synergistic Two-Layer Scheduling Framework for LLM Serving
por: Zhang, Yue, et al.
Publicado: (2025)

DPBalance: Efficient and Fair Privacy Budget Scheduling for Federated Learning as a Service
por: Liu, Yu, et al.
Publicado: (2024)

Schedule-Level Shared-Prefix Reuse for LLM RL Training
por: Li, Pengbo, et al.
Publicado: (2026)

Argus: Token Aware Distributed LLM Inference Optimization
por: Wu, Panlong, et al.
Publicado: (2025)

InfiniLoRA: Disaggregated Multi-LoRA Serving for Large Language Models
por: Chen, Hongyu, et al.
Publicado: (2026)

Mosaic: Towards Efficient Training of Multimodal Models with Spatial Resource Multiplexing
por: Wang, Yanbo, et al.
Publicado: (2026)

Agent.xpu: Efficient Scheduling of Agentic LLM Workloads on Heterogeneous SoC
por: Wei, Xinming, et al.
Publicado: (2025)

Efficient LLM Inference with Activation Checkpointing and Hybrid Caching
por: Lee, Sanghyeon, et al.
Publicado: (2025)

Scale: Deep Reinforcement Learning for Container Scheduling in Serverless Edge Computing
por: Chen, Chen, et al.
Publicado: (2026)

HydraInfer: Hybrid Disaggregated Scheduling for Multimodal Large Language Model Serving
por: Dong, Xianzhe, et al.
Publicado: (2025)

Serving Hybrid LLM Loads with SLO Guarantees Using CPU-GPU Attention Piggybacking
por: Mo, Zizhao, et al.
Publicado: (2026)

GPU Programming for AI Workflow Development on AWS SageMaker: An Instructional Approach
por: Srinivasan, Sriram, et al.
Publicado: (2025)

PROSERVE: Unified Multi-Priority Request Scheduling for LLM Serving
por: Huang, Weizhe, et al.
Publicado: (2025)

In Serverless, OS Scheduler Choice Costs Money: A Hybrid Scheduling Approach for Cheaper FaaS
por: Zhao, Yuxuan, et al.
Publicado: (2024)