From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification

Documenti analoghi

• Conflict-Free Policy Languages for Probabilistic ML Predicates: A Framework and Case Study with the Semantic Router DSL
  di: Liu, Xunzhuo, et al.
  Pubblicazione: (2026)
• Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• Token-Budget-Aware Pool Routing for Cost-Efficient LLM Inference
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)