Image de couverture de livre

SGLang: Efficient Execution of Structured Language Model Programs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zheng, Lianmin, Yin, Liangsheng, Xie, Zhiqiang, Sun, Chuyue, Huang, Jeff, Yu, Cody Hao, Cao, Shiyi, Kozyrakis, Christos, Stoica, Ion, Gonzalez, Joseph E., Barrett, Clark, Sheng, Ying
Format:	Preprint
Publié:	2023
Sujets:	Artificial Intelligence Programming Languages
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution
par: Xie, Zhiqiang, et autres
Publié: (2024)

Post-Training Sparse Attention with Double Sparsity
par: Yang, Shuo, et autres
Publié: (2024)

Clover: Closed-Loop Verifiable Code Generation
par: Sun, Chuyue, et autres
Publié: (2023)

K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
par: Cao, Shiyi, et autres
Publié: (2026)

Teaching Cloud Infrastructure and Scalable Application Deployment in an Undergraduate Computer Science Program
par: Saligrama, Aditya, et autres
Publié: (2024)

FailSafe: High-performance Resilient Serving
par: Xu, Ziyi, et autres
Publié: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

Locality-aware Fair Scheduling in LLM Serving
par: Cao, Shiyi, et autres
Publié: (2025)

Fairness in Serving Large Language Models
par: Sheng, Ying, et autres
Publié: (2023)

Cloud Atlas: Efficient Fault Localization for Cloud Systems using Language Models and Causal Insight
par: Xie, Zhiqiang, et autres
Publié: (2024)

Efficient GNN Training Through Structure-Aware Randomized Mini-Batching
par: Balaji, Vignesh, et autres
Publié: (2025)

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference
par: Jiang, Xuanlin, et autres
Publié: (2024)

Prism: Unleashing GPU Sharing for Cost-Efficient Multi-LLM Serving
par: Yu, Shan, et autres
Publié: (2025)

Sparse Checkpointing for Fast and Reliable MoE Training
par: Gandhi, Swapnil, et autres
Publié: (2024)

Some Present-Day Problems of Romanian Library Science
par: Stoica, Ion
Publié: (1973)

The Central University Library, Bucharest. Over Seventy-five Years in the History of a Collection
par: Stoica, Ion
Publié: (1972)

Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution
par: Park, Jongseok, et autres
Publié: (2026)

MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
par: Cao, Shiyi, et autres
Publié: (2024)

Executive individualism and the tone of firms' annual reports
par: Wei Jiang, et autres
Publié: (2024)

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
par: Chiang, Wei-Lin, et autres
Publié: (2024)

On Optimizing the Communication of Model Parallelism
par: Zhuang, Yonghao, et autres
Publié: (2022)

Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4
par: Aniva, Leni, et autres
Publié: (2024)

cedar: Optimized and Unified Machine Learning Input Data Pipelines
par: Zhao, Mark, et autres
Publié: (2024)

Hunting CUDA Bugs at Scale with cuFuzz
par: ziad, Mohamed Tarek Ibn, et autres
Publié: (2026)

BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
par: Zhao, Yilong, et autres
Publié: (2024)

S*: Test Time Scaling for Code Generation
par: Li, Dacheng, et autres
Publié: (2025)

The Streaming Batch Model for Efficient and Fault-Tolerant Heterogeneous Execution
par: Luan, Frank Sifei, et autres
Publié: (2025)

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
par: Zheng, Lianmin, et autres
Publié: (2023)

VeriStruct: AI-assisted Automated Verification of Data-Structure Modules in Verus
par: Sun, Chuyue, et autres
Publié: (2025)

Strata: Hierarchical Context Caching for Long Context Language Model Serving
par: Xie, Zhiqiang, et autres
Publié: (2025)

Efficient LLM Scheduling by Learning to Rank
par: Fu, Yichao, et autres
Publié: (2024)

How Fast Can I Run My VLA? Demystifying VLA Inference Performance with VLA-Perf
par: Jiang, Wenqi, et autres
Publié: (2026)

LIMINAL: Exploring The Frontiers of LLM Decode Performance
par: Davies, Michael, et autres
Publié: (2025)

ReCycle: Resilient Training of Large DNNs using Pipeline Adaptation
par: Gandhi, Swapnil, et autres
Publié: (2024)

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
par: Fu, Yichao, et autres
Publié: (2024)

SYMI: Efficient Mixture-of-Experts Training via Model and Optimizer State Decoupling
par: Skiadopoulos, Athinagoras, et autres
Publié: (2025)

LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!
par: Li, Dacheng, et autres
Publié: (2025)

Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile
par: Ding, Hangliang, et autres
Publié: (2025)

Autellix: An Efficient Serving Engine for LLM Agents as General Programs
par: Luo, Michael, et autres
Publié: (2025)

Regulating Branch Parallelism in LLM Serving
par: Gandhi, Swapnil, et autres
Publié: (2026)