Cover Image

LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Hao, Zhang, Yiqun, Guo, Zhaoyan, Wang, Chenxu, Tang, Shengji, Zhang, Qiaosheng, Chen, Yang, Qi, Biqing, Ye, Peng, Bai, Lei, Wang, Zhen, Hu, Shuyue
Format:	Preprint
Published:	2026
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ICL-Router: In-Context Learned Model Representations for LLM Routing
by: Wang, Chenxu, et al.
Published: (2025)

Beyond Gemini-3-Pro: Revisiting LLM Routing and Aggregation at Scale
by: Tang, Shengji, et al.
Published: (2026)

Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation
by: Cui, Zhiyao, et al.
Published: (2026)

Beyond GPT-5: Making LLMs Cheaper and Better via Performance-Efficiency Optimized Routing
by: Zhang, Yiqun, et al.
Published: (2025)

The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants
by: Zhang, Yiqun, et al.
Published: (2025)

Provably Efficient Information-Directed Sampling Algorithms for Multi-Agent Reinforcement Learning
by: Zhang, Qiaosheng, et al.
Published: (2024)

MTRouter: Cost-Aware Multi-Turn LLM Routing with History-Model Joint Embeddings
by: Zhang, Yiqun, et al.
Published: (2026)

Learning Compact Representations of LLM Abilities via Item Response Theory
by: Chen, Jianhao, et al.
Published: (2025)

A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement
by: Tang, Shengji, et al.
Published: (2025)

Graph Attention is Not Always Beneficial: A Theoretical Analysis of Graph Attention Mechanisms via Contextual Stochastic Block Models
by: Ma, Zhongtian, et al.
Published: (2024)

TokenPowerBench: Benchmarking the Power Consumption of LLM Inference
by: Niu, Chenxu, et al.
Published: (2025)

MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems
by: Ai, Qingyao, et al.
Published: (2025)

Disentangling Intent from Role: Adversarial Self-Play for Persona-Invariant Safety Alignment
by: Li, Jiajia, et al.
Published: (2026)

MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing
by: Ma, Haoxuan, et al.
Published: (2026)

Nature-Inspired Population-Based Evolution of Large Language Models
by: Zhang, Yiqun, et al.
Published: (2025)

Adaptive Theory of Mind for LLM-based Multi-Agent Coordination
by: Mu, Chunjiang, et al.
Published: (2026)

Matrix Completion with Hypergraphs:Sharp Thresholds and Efficient Algorithms
by: Ma, Zhongtian, et al.
Published: (2024)

Ensemble Successor Representations for Task Generalization in Offline-to-Online Reinforcement Learning
by: Wang, Changhong, et al.
Published: (2024)

The Path of Self-Evolving Large Language Models: Achieving Data-Efficient Learning via Intrinsic Feedback
by: Zhang, Hangfan, et al.
Published: (2025)

Organizing, Orchestrating, and Benchmarking Agent Skills at Ecosystem Scale
by: Li, Hao, et al.
Published: (2026)

Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity
by: Zhang, Hangfan, et al.
Published: (2025)

Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence
by: Hu, Shuyue, et al.
Published: (2025)

Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decomposition
by: Yuan, Wenzhen, et al.
Published: (2026)

CTTS: Collective Test-Time Scaling
by: Song, Zhende, et al.
Published: (2025)

Misclassification Rate and Privacy-Utility Trade-offs in Graph Convolutional Networks via Subsampling Stability
by: Zhang, Yexin, et al.
Published: (2026)

ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark
by: Wang, He, et al.
Published: (2025)

RAGRouter-Bench: A Dataset and Benchmark for Adaptive RAG Routing
by: Wang, Ziqi, et al.
Published: (2026)

RouterBench: A Benchmark for Multi-LLM Routing System
by: Hu, Qitian Jason, et al.
Published: (2024)

PerPilot: Personalizing VLM-based Mobile Agents via Memory and Exploration
by: Wang, Xin, et al.
Published: (2025)

Seeing Delta Parameters as JPEG Images: Data-Free Delta Compression with Discrete Cosine Transform
by: Huang, Chenyu, et al.
Published: (2025)

iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework
by: Fang, Jianjie, et al.
Published: (2026)

ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing
by: Pan, Yulin, et al.
Published: (2025)

Follow-Bench: A Unified Motion Planning Benchmark for Socially-Aware Robot Person Following
by: Ye, Hanjing, et al.
Published: (2025)

VL-RouterBench: A Benchmark for Vision-Language Model Routing
by: Huang, Zhehao, et al.
Published: (2025)

S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning
by: Lin, Weihao, et al.
Published: (2024)

Community Detection in the Multi-View Stochastic Block Model
by: Zhang, Yexin, et al.
Published: (2024)

Gated Graph Attention Networks with Learnable Temperature
by: Ma, Zhongtian, et al.
Published: (2026)

ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems
by: Xue, Xiangyuan, et al.
Published: (2024)

Less is More: Efficient Model Merging with Binary Task Switch
by: Qi, Biqing, et al.
Published: (2024)

QuanBench+: A Unified Multi-Framework Benchmark for LLM-Based Quantum Code Generation
by: Slim, Ali, et al.
Published: (2026)