Cover Image

When to Reason: Semantic Router for vLLM

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Chen, Liu, Xunzhuo, Liu, Yuhan, Zhu, Yue, Mo, Xiangxi, Jiang, Junchen, Chen, Huamin
Format:	Preprint
Published:	2025
Subjects:	Emerging Technologies Artificial Intelligence Computation and Language Systems and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twins
by: Xia, Yuchen, et al.
Published: (2024)

Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions
by: Mahmud, Doaa, et al.
Published: (2025)

Agentic AI Systems in Electrical Power Systems Engineering: Current State-of-the-Art and Challenges
by: Ghosh, Soham, et al.
Published: (2025)

Beyond Formal Semantics for Capabilities and Skills: Model Context Protocol in Manufacturing
by: da Silva, Luis Miguel Vieira, et al.
Published: (2025)

PhantomLiDAR: Cross-modality Signal Injection Attacks against LiDAR
by: Jin, Zizhi, et al.
Published: (2024)

Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges
by: Wang, Yuxing, et al.
Published: (2025)

A Unified Generative-AI Framework for Smart Energy Infrastructure: Intelligent Gas Distribution, Utility Billing, Carbon Analytics, and Quantum-Inspired Optimisation
by: Manjunath, Pavan, et al.
Published: (2026)

AI Simulation by Digital Twins: Systematic Survey, Reference Framework, and Mapping to a Standardized Architecture
by: Liu, Xiaoran, et al.
Published: (2025)

The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
by: Chen, Huamin, et al.
Published: (2026)

Neuromorphic Event-Driven Semantic Communication in Microgrids
by: Diao, Xiaoguang, et al.
Published: (2024)

Fusion Intelligence: Confluence of Natural and Artificial Intelligence for Enhanced Problem-Solving Efficiency
by: Kalavakonda, Rohan Reddy, et al.
Published: (2024)

Closed-loop multi-step planning with innate physics knowledge
by: Lafratta, Giulia, et al.
Published: (2024)

Cooperative Robotics Reinforced by Collective Perception for Traffic Moderation
by: Khoshkdahan, Mohammad, et al.
Published: (2026)

Large Language Model-Based Intelligent Antenna Design System
by: Wu, Tao, et al.
Published: (2025)

AmpAgent: An LLM-based Multi-Agent System for Multi-stage Amplifier Schematic Design from Literature for Process and Performance Porting
by: Liu, Chengjie, et al.
Published: (2024)

Training-Free Agentic AI: Probabilistic Control and Coordination in Multi-Agent LLM Systems
by: Hosseini, Mohammad Parsa, et al.
Published: (2026)

Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
by: Chen, Huamin, et al.
Published: (2026)

DBPnet: Damper Characteristics-Based Bayesian Physics-Informed Neural Network for Wheel Load Estimation
by: Wang, Tianyi, et al.
Published: (2026)

Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibility
by: Xia, Yuchen, et al.
Published: (2024)

A Solvable Molecular Switch Model for Stable Temporal Information Processing
by: Nurdin, H. I., et al.
Published: (2025)

From Actions to Understanding: Conformal Interpretability of Temporal Concepts in LLM Agents
by: Padhi, Trilok, et al.
Published: (2026)

Interacting Large Language Model Agents. Interpretable Models and Social Learning
by: Jain, Adit, et al.
Published: (2024)

The Algorithmic State Architecture (ASA): An Integrated Framework for AI-Enabled Government
by: Engin, Zeynep, et al.
Published: (2025)

ClinEnv: An Interactive Multi-Stage Long Horizon EHR Environment for Agents
by: Lu, Yuxing, et al.
Published: (2026)

Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models
by: Sprigler, Asher, et al.
Published: (2024)

Scaling Multiagent Systems with Process Rewards
by: Li, Ed, et al.
Published: (2026)

BIDA: A Bi-level Interaction Decision-making Algorithm for Autonomous Vehicles in Dynamic Traffic Scenarios
by: Yu, Liyang, et al.
Published: (2025)

Receding Hamiltonian-Informed Optimal Neural Control and State Estimation for Closed-Loop Dynamical Systems
by: Rivera, Josue N., et al.
Published: (2024)

Deep Learning for Model-Free Prediction of Thermal States of Robot Joint Motors
by: La, Trung Kien, et al.
Published: (2025)

Deep Generative and Discriminative Digital Twin endowed with Variational Autoencoder for Unsupervised Predictive Thermal Condition Monitoring of Physical Robots in Industry 6.0 and Society 6.0
by: Kaigom, Eric Guiffo
Published: (2025)

Robotics Under Construction: Challenges on Job Sites
by: Uchiito, Haruki, et al.
Published: (2025)

Anomaly Detection in California Electricity Price Forecasting: Enhancing Accuracy and Reliability Using Principal Component Analysis
by: Nyangon, Joseph, et al.
Published: (2024)

Spike Talk in Power Electronic Grids -- Leveraging Post Moore's Computing Laws
by: Song, Yubo, et al.
Published: (2024)

Zero-Shot Confidence Estimation for Small LLMs: When Supervised Baselines Aren't Worth Training
by: Nguyen, Luong N.
Published: (2026)

Can Large Language Models Act as Symbolic Reasoners?
by: Sullivan, Rob, et al.
Published: (2024)

Functional Safety Analysis for Infrastructure-Enabled Depot Autonomy System
by: Pandey, Gaurav, et al.
Published: (2026)

RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
by: Khaliq, M. Abdul, et al.
Published: (2024)

98$\times$ Faster LLM Routing Without a Dedicated GPU: Flash Attention, Prompt Compression, and Near-Streaming for the vLLM Semantic Router
by: Liu, Xunzhuo, et al.
Published: (2026)

TruthTensor: Evaluating LLMs through Human Imitation on Prediction Market under Drift and Holistic Reasoning
by: Shahabi, Shirin, et al.
Published: (2026)

Bayesian Orchestration of Multi-LLM Agents for Cost-Aware Sequential Decision-Making
by: Amin, Danial
Published: (2026)