Cover Image

Towards Fair and Comprehensive Evaluation of Routers in Collaborative LLM Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Wanxing, Zhu, He, Li, Yixia, Yang, Lei, Zhao, Jiehui, Wang, Hongru, Yang, Jian, Wang, Benyou, Jing, Bingyi, Chen, Guanhua
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs
by: Yang, Yan, et al.
Published: (2025)

Representation-Guided Parameter-Efficient LLM Unlearning
by: Xiao, Zeguan, et al.
Published: (2026)

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning
by: Wang, Hanqing, et al.
Published: (2024)

BiasScope: Towards Automated Detection of Bias in LLM-as-a-Judge Evaluation
by: Lai, Peng, et al.
Published: (2026)

ChineseSafe: A Chinese Benchmark for Evaluating Safety in Large Language Models
by: Zhang, Hengxiang, et al.
Published: (2024)

Enhancing Large Language Model Reasoning via Selective Critical Token Fine-Tuning
by: Ruan, Zhiwen, et al.
Published: (2025)

CP-Router: An Uncertainty-Aware Router Between LLM and LRM
by: Su, Jiayuan, et al.
Published: (2025)

Router Upcycling: Leveraging Mixture-of-Routers in Mixture-of-Experts Upcycling
by: Ran, Junfeng, et al.
Published: (2025)

AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering
by: Zhang, Zheyuan, et al.
Published: (2025)

PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
by: Xue, Tianci, et al.
Published: (2023)

SurveyEval: Towards Comprehensive Evaluation of LLM-Generated Academic Surveys
by: Zhao, Jiahao, et al.
Published: (2025)

Toward Super Agent System with Hybrid AI Routers
by: Yao, Yuhang, et al.
Published: (2025)

From Word to World: Can Large Language Models be Implicit Text-based World Models?
by: Li, Yixia, et al.
Published: (2025)

LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy
by: Ruan, Zhiwen, et al.
Published: (2025)

Towards Reliable and Interpretable Traffic Crash Pattern Prediction and Safety Interventions Using Customized Large Language Models
by: Zhao, Yang, et al.
Published: (2025)

SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation
by: Li, Yixia, et al.
Published: (2024)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
by: Hou, Yutao, et al.
Published: (2024)

WebRouter: Query-specific Router via Variational Information Bottleneck for Cost-sensitive Web Agent
by: Li, Tao, et al.
Published: (2025)

SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View
by: Xiao, Yongjie, et al.
Published: (2025)

When to Reason: Semantic Router for vLLM
by: Wang, Chen, et al.
Published: (2025)

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
by: Liu, Jun, et al.
Published: (2025)

DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations
by: Zhang, Yazhou, et al.
Published: (2023)

Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurement
by: Cheng, Zihao, et al.
Published: (2024)

G2: Guided Generation for Enhanced Output Diversity in LLMs
by: Ruan, Zhiwen, et al.
Published: (2025)

Modeling LLM Unlearning as an Asymmetric Two-Task Learning Problem
by: Xiao, Zeguan, et al.
Published: (2026)

FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarios
by: Hou, Yutao, et al.
Published: (2026)

Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration
by: Zhang, Yang, et al.
Published: (2024)

Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter
by: Xiao, Zeguan, et al.
Published: (2026)

Pushing The Limit of LLM Capacity for Text Classification
by: Zhang, Yazhou, et al.
Published: (2024)

Self-Guard: Empower the LLM to Safeguard Itself
by: Wang, Zezhong, et al.
Published: (2023)

RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysis
by: Wu, Pengzuo, et al.
Published: (2025)

Smurfs: Multi-Agent System using Context-Efficient DFSDT for Tool Planning
by: Chen, Junzhi, et al.
Published: (2024)

Human or LLM as Standardized Patients? A Comparative Study for Medical Education
by: Zhang, Bingquan, et al.
Published: (2025)

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay
by: Lan, Yihuai, et al.
Published: (2023)

LightRouter: Towards Efficient LLM Collaboration with Minimal Overhead
by: Zhang, Yifan, et al.
Published: (2025)

Mixture of Routers
by: Zhang, Jia-Chen, et al.
Published: (2025)

DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router
by: Guo, Minghao, et al.
Published: (2025)

Arch-Router: Aligning LLM Routing with Human Preferences
by: Tran, Co, et al.
Published: (2025)

OrcaRouter: A Production-Oriented LLM Router with Hybrid Offline-Online Learning
by: Bao, Zhenghua, et al.
Published: (2026)

LLM Router: Rethinking Routing with Prefill Activations
by: Varshney, Tanay, et al.
Published: (2026)