Cover Image

Flow-Controlled Scheduling for LLM Inference with Provable Stability Guarantees

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dong, Zhuolun, Cao, Junyu
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement
by: Jung, Jaehun, et al.
Published: (2024)

Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee
by: Hung, Yu-Heng, et al.
Published: (2025)

Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inference
by: Xie, Hongrui, et al.
Published: (2026)

Semantic Scheduling for LLM Inference
by: Hua, Wenyue, et al.
Published: (2025)

Dynamic Spectral Clustering with Provable Approximation Guarantee
by: Laenen, Steinar, et al.
Published: (2024)

Gradient Descent with Provably Tuned Learning-rate Schedules
by: Sharma, Dravyansh
Published: (2025)

Model-agnostic Selective Labeling with Provable Statistical Guarantees
by: Huang, Huipeng, et al.
Published: (2025)

Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
by: Deng, Yuyang, et al.
Published: (2024)

Provably Efficient Off-Policy Adversarial Imitation Learning with Convergence Guarantees
by: Chen, Yilei, et al.
Published: (2024)

Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
by: Nichani, Eshaan, et al.
Published: (2023)

KQ-SVD: Compressing the KV Cache with Provable Guarantees on Attention Fidelity
by: Lesens, Damien, et al.
Published: (2025)

On the Provable Performance Guarantee of Efficient Reasoning Models
by: Zeng, Hao, et al.
Published: (2025)

Ward: Provable RAG Dataset Inference via LLM Watermarks
by: Jovanović, Nikola, et al.
Published: (2024)

Deciphering Raw Data in Neuro-Symbolic Learning with Provable Guarantees
by: Tao, Lue, et al.
Published: (2023)

Active Learning for Decision Trees with Provable Guarantees
by: Moakhar, Arshia Soltani, et al.
Published: (2026)

A Conformal Approach to Feature-based Newsvendor under Model Misspecification
by: Cao, Junyu
Published: (2024)

Product-Stability: Provable Convergence for Gradient Descent on the Edge of Stability
by: Gan, Eric
Published: (2026)

Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents
by: Dai, J. G., et al.
Published: (2025)

Spatiotemporal-aware Trend-Seasonality Decomposition Network for Traffic Flow Forecasting
by: Cao, Lingxiao, et al.
Published: (2025)

Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guarantees
by: Hadad, Itamar, et al.
Published: (2026)

Inference via Interpolation: Contrastive Representations Provably Enable Planning and Inference
by: Eysenbach, Benjamin, et al.
Published: (2024)

Tuning Algorithmic and Architectural Hyperparameters in Graph-Based Semi-Supervised Learning with Provable Guarantees
by: Du, Ally Yalei, et al.
Published: (2025)

Towards Certified Malware Detection: Provable Guarantees Against Evasion Attacks
by: Giri, Nandakrishna, et al.
Published: (2026)

First Provable Guarantees for Practical Private FL: Beyond Restrictive Assumptions
by: Shulgin, Egor, et al.
Published: (2025)

Enumerating Safe Regions in Deep Neural Networks with Provable Probabilistic Guarantees
by: Marzari, Luca, et al.
Published: (2023)

Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inference
by: Luo, Yuhong, et al.
Published: (2025)

Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problems
by: Altekrüger, Fabian, et al.
Published: (2023)

Variational Inference with Coverage Guarantees in Simulation-Based Inference
by: Patel, Yash, et al.
Published: (2023)

Online Scheduling for LLM Inference with KV Cache Constraints
by: Jaillet, Patrick, et al.
Published: (2025)

Optimal Scheduling Algorithms for LLM Inference: Theory and Practice
by: Bari, Agrim, et al.
Published: (2025)

Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
by: Gao, Shihong, et al.
Published: (2025)

Symmetry Guarantees Statistic Recovery in Variational Inference
by: Marks, Daniel, et al.
Published: (2026)

Compute Optimal Inference and Provable Amortisation Gap in Sparse Autoencoders
by: O'Neill, Charles, et al.
Published: (2024)

Absorb and Converge: Provable Convergence Guarantee for Absorbing Discrete Diffusion Models
by: Liang, Yuchen, et al.
Published: (2025)

ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference
by: Oh, Hyungjun, et al.
Published: (2024)

PecSched: Preemptive and Efficient Cluster Scheduling for LLM Inference
by: Zhang, Zeyu, et al.
Published: (2024)

ML Inference Scheduling with Predictable Latency
by: Zhao, Haidong, et al.
Published: (2025)

Provable Mixed-Noise Learning with Flow-Matching
by: Hagemann, Paul, et al.
Published: (2025)

A Probabilistic Approach for Model Alignment with Human Comparisons
by: Cao, Junyu, et al.
Published: (2024)

Reinforcement Learning for Control with Probabilistic Stability Guarantee: A Finite-Sample Approach
by: Han, Minghao, et al.
Published: (2026)