Imagen de Portada

Compass: SLO-aware Query Planner for Compound AI Serving at Scale

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Banruo, Lin, Wei-Yu, Fang, Minghao, Jiang, Yihan, Lai, Fan
Formato:	Preprint
Publicado:	2025
Materias:	Databases Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

JITServe: SLO-aware LLM Serving with Imprecise Request Information
por: Zhang, Wei, et al.
Publicado: (2025)

Budget-aware Query Tuning: An AutoML Perspective
por: Wu, Wentao, et al.
Publicado: (2024)

MaskSearch: Querying Image Masks at Scale
por: He, Dong, et al.
Publicado: (2023)

HedraRAG: Coordinating LLM Generation and Database Retrieval in Heterogeneous RAG Serving
por: Hu, Zhengding, et al.
Publicado: (2025)

The CAP Principle for LLM Serving: A Survey of Long-Context Large Language Model Serving
por: Zeng, Pai, et al.
Publicado: (2024)

ACE: A Cardinality Estimator for Set-Valued Queries
por: Sheng, Yufan, et al.
Publicado: (2025)

Hydro: Adaptive Query Processing of ML Queries
por: Kakkar, Gaurav Tarlok, et al.
Publicado: (2024)

RAGPulse: An Open-Source RAG Workload Trace to Optimize RAG Serving Systems
por: Wang, Zhengchao, et al.
Publicado: (2025)

PolyServe: Efficient Multi-SLO Serving at Scale
por: Zhu, Kan, et al.
Publicado: (2025)

Rethinking Caching for LLM Serving Systems: Beyond Traditional Heuristics
por: Kim, Jungwoo, et al.
Publicado: (2025)

RCRank: Multimodal Ranking of Root Causes of Slow Queries in Cloud Database Systems
por: Ouyang, Biao, et al.
Publicado: (2025)

Efficient Vector Search in the Wild: One Model for Multi-K Queries
por: Peng, Yifan, et al.
Publicado: (2026)

Private Queries with Sigma-Counting
por: Gao, Jun, et al.
Publicado: (2025)

Demonstration of MaskSearch: Efficiently Querying Image Masks for Machine Learning Workflows
por: Wei, Lindsey Linxi, et al.
Publicado: (2024)

Optimizing LLM Queries in Relational Data Analytics Workloads
por: Liu, Shu, et al.
Publicado: (2024)

The Unreasonable Effectiveness of LLMs for Query Optimization
por: Akioyamen, Peter, et al.
Publicado: (2024)

TranSQL+: Serving Large Language Models with SQL on Low-Resource Hardware
por: Sun, Wenbo, et al.
Publicado: (2025)

ResidualPlanner+: a scalable matrix mechanism for marginals and beyond
por: Xiao, Yingtai, et al.
Publicado: (2023)

AdaServe: Accelerating Multi-SLO LLM Serving with SLO-Customized Speculative Decoding
por: Li, Zikun, et al.
Publicado: (2025)

Low Rank Learning for Offline Query Optimization
por: Yi, Zixuan, et al.
Publicado: (2025)

Predictive Query-based Pipeline for Graph Data
por: Neto, Plácido A Souza
Publicado: (2024)

Incorporating Deep Learning Design in Database Queries
por: Lubarsky, Yuval Lev, et al.
Publicado: (2026)

Adversarial Query Synthesis via Bayesian Optimization
por: Tao, Jeffrey, et al.
Publicado: (2026)

Sibyl: Forecasting Time-Evolving Query Workloads
por: Huang, Hanxian, et al.
Publicado: (2024)

Improving DBMS Scheduling Decisions with Fine-grained Performance Prediction on Concurrent Queries -- Extended
por: Wu, Ziniu, et al.
Publicado: (2025)

A Declarative Query Language for Scientific Machine Learning
por: Jamil, Hasan M
Publicado: (2024)

SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses
por: Wu, Yifan, et al.
Publicado: (2026)

KVzip: Query-Agnostic KV Cache Compression with Context Reconstruction
por: Kim, Jang-Hyun, et al.
Publicado: (2025)

SemBench: A Benchmark for Semantic Query Processing Engines
por: Lao, Jiale, et al.
Publicado: (2025)

SLO-aware GPU Frequency Scaling for Energy Efficient LLM Inference Serving
por: Kakolyris, Andreas Kosmas, et al.
Publicado: (2024)

Training-Free Query Optimization via LLM-Based Plan Similarity
por: Vasilenko, Nikita, et al.
Publicado: (2025)

RELOAD: A Robust and Efficient Learned Query Optimizer for Database Systems
por: Lee, Seokwon, et al.
Publicado: (2026)

LearnedWMP: Workload Memory Prediction Using Distribution of Query Templates
por: Quader, Shaikh, et al.
Publicado: (2024)

Tradeoffs in Processing Queries and Supporting Updates over an ML-Enhanced R-tree
por: Al-Mamun, Abdullah, et al.
Publicado: (2025)

Cross-domain-aware Worker Selection with Training for Crowdsourced Annotation
por: Sun, Yushi, et al.
Publicado: (2024)

EdgeServe: A Streaming System for Decentralized Model Serving
por: Shaowang, Ted, et al.
Publicado: (2023)

An LLM-Guided Query-Aware Inference System for GNN Models on Large Knowledge Graphs
por: Afandi, Waleed, et al.
Publicado: (2026)

QJoin: Transformation-aware Joinable Data Discovery Using Reinforcement Learning
por: Wang, Ning, et al.
Publicado: (2025)

From Zero to Hero: Detecting Leaked Data through Synthetic Data Injection and Model Querying
por: Wu, Biao, et al.
Publicado: (2023)

GAN-based Tabular Data Generator for Constructing Synopsis in Approximate Query Processing: Challenges and Solutions
por: Fallahian, Mohammadali, et al.
Publicado: (2022)