Conflict-Free Policy Languages for Probabilistic ML Predicates: A Framework and Case Study with the Semantic Router DSL

Documenti analoghi

• Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• 98$\times$ Faster LLM Routing Without a Dedicated GPU: Flash Attention, Prompt Compression, and Near-Streaming for the vLLM Semantic Router
  di: Liu, Xunzhuo, et al.
  Pubblicazione: (2026)
• Category-Aware Semantic Caching for Heterogeneous LLM Workloads
  di: Wang, Chen, et al.
  Pubblicazione: (2025)