GhostServe: A Lightweight Checkpointing System in the Shadow for Fault-Tolerant LLM Serving

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jayakody, Shakya, Zhao, Youpeng, Nehate, Chinmay Dhanraj, Wang, Jun
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913082439106560
author Jayakody, Shakya
Zhao, Youpeng
Nehate, Chinmay Dhanraj
Wang, Jun
author_facet Jayakody, Shakya
Zhao, Youpeng
Nehate, Chinmay Dhanraj
Wang, Jun
contents The rise of million-token, agent-based applications has placed unprecedented demands on large language model (LLM) inference services. The long-running nature of these tasks increases their susceptibility to hardware and software faults, leading to costly job failures, wasted resources, and degraded user experience. The stateful key-value (KV) cache, which grows with the sequence length, presents a central challenge as it is a critical and vulnerable component in distributed serving systems. In this work, we propose GhostServe, a novel checkpointing solution to facilitate fault-tolerant LLM serving. Specifically, GhostServe protects the streaming KV cache in the shadow by applying erasure coding to generate and store the parity shards in host memory. In the event of device failures, GhostServe enables fast reconstruction of the lost KV cache, allowing the inference process to resume seamlessly without costly full recomputation or state replication. Evaluations demonstrate that GhostServe reduces checkpointing latency by up to 2.7x and recovery latency by 2.1x for a single batch, and 1.2x median response latency compared to existing methods, in the presence of system failures, paving the way for high-availability and cost-effective LLM serving at scale.
format Preprint
id arxiv_https___arxiv_org_abs_2605_00831
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle GhostServe: A Lightweight Checkpointing System in the Shadow for Fault-Tolerant LLM Serving
Jayakody, Shakya
Zhao, Youpeng
Nehate, Chinmay Dhanraj
Wang, Jun
Distributed, Parallel, and Cluster Computing
Artificial Intelligence
Performance
The rise of million-token, agent-based applications has placed unprecedented demands on large language model (LLM) inference services. The long-running nature of these tasks increases their susceptibility to hardware and software faults, leading to costly job failures, wasted resources, and degraded user experience. The stateful key-value (KV) cache, which grows with the sequence length, presents a central challenge as it is a critical and vulnerable component in distributed serving systems. In this work, we propose GhostServe, a novel checkpointing solution to facilitate fault-tolerant LLM serving. Specifically, GhostServe protects the streaming KV cache in the shadow by applying erasure coding to generate and store the parity shards in host memory. In the event of device failures, GhostServe enables fast reconstruction of the lost KV cache, allowing the inference process to resume seamlessly without costly full recomputation or state replication. Evaluations demonstrate that GhostServe reduces checkpointing latency by up to 2.7x and recovery latency by 2.1x for a single batch, and 1.2x median response latency compared to existing methods, in the presence of system failures, paving the way for high-availability and cost-effective LLM serving at scale.
title GhostServe: A Lightweight Checkpointing System in the Shadow for Fault-Tolerant LLM Serving
topic Distributed, Parallel, and Cluster Computing
Artificial Intelligence
Performance
url https://arxiv.org/abs/2605.00831