Imagen de Portada

WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ning, Kangyun, Su, Yisong, Lv, Xueqiang, Zhang, Yuanzhe, Liu, Jian, Liu, Kang, Xu, Jinan
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Dual-Space Knowledge Distillation for Large Language Models
por: Zhang, Songming, et al.
Publicado: (2024)

CPG-EVAL: A Multi-Tiered Benchmark for Evaluating the Chinese Pedagogical Grammar Competence of Large Language Models
por: Wang, Dong
Publicado: (2025)

Multilingual Collaborative Defense for Large Language Models
por: Li, Hongliang, et al.
Publicado: (2025)

ToolNet: Connecting Large Language Models with Massive Tools via Tool Graph
por: Liu, Xukun, et al.
Publicado: (2024)

A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers
por: Huang, Kaiyu, et al.
Publicado: (2024)

Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Models
por: Tian, Runchu, et al.
Publicado: (2025)

Progressively Label Enhancement for Large Language Model Alignment
por: Liu, Biao, et al.
Publicado: (2024)

ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models
por: Zhang, Yuxiang, et al.
Publicado: (2024)

Benchmarking Benchmark Leakage in Large Language Models
por: Xu, Ruijie, et al.
Publicado: (2024)

RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning
por: Ye, Junjie, et al.
Publicado: (2024)

Evaluating Quantized Large Language Models
por: Li, Shiyao, et al.
Publicado: (2024)

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models
por: Chen, Yuyan, et al.
Publicado: (2024)

MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
por: Bai, Ge, et al.
Publicado: (2024)

QuarkMedBench: A Real-World Scenario Driven Benchmark for Evaluating Large Language Models
por: Wu, Yao, et al.
Publicado: (2026)

CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Models
por: Yu, Linhao, et al.
Publicado: (2024)

TInR: Exploring Tool-Internalized Reasoning in Large Language Models
por: Xu, Qiancheng, et al.
Publicado: (2026)

PEToolLLM: Towards Personalized Tool Learning in Large Language Models
por: Xu, Qiancheng, et al.
Publicado: (2025)

ToolSpectrum : Towards Personalized Tool Utilization for Large Language Models
por: Cheng, Zihao, et al.
Publicado: (2025)

Evaluating Large Language Models for Financial Reasoning: A CFA-Based Benchmark Study
por: Yao, Xuan, et al.
Publicado: (2025)

Re-Initialization Token Learning for Tool-Augmented Large Language Models
por: Li, Chenghao, et al.
Publicado: (2025)

Deep Value Benchmark: Measuring Whether Models Generalize Deep Values or Shallow Preferences
por: Ashkinaze, Joshua, et al.
Publicado: (2025)

MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models
por: Liu, Mianxin, et al.
Publicado: (2024)

GLoRE: Evaluating Logical Reasoning of Large Language Models
por: liu, Hanmeng, et al.
Publicado: (2023)

Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models
por: Shi, Zhengliang, et al.
Publicado: (2025)

Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Models
por: Liu, Biao, et al.
Publicado: (2025)

Leveraging Computerized Adaptive Testing for Cost-effective Evaluation of Large Language Models in Medical Benchmarking
por: Zheng, Tianpeng, et al.
Publicado: (2026)

TD-EVAL: Revisiting Task-Oriented Dialogue Evaluation by Combining Turn-Level Precision with Dialogue-Level Comparisons
por: Acikgoz, Emre Can, et al.
Publicado: (2025)

Does Knowledge Localization Hold True? Surprising Differences Between Entity and Relation Perspectives in Language Models
por: Wei, Yifan, et al.
Publicado: (2024)

Evaluating the Performance of Large Language Models on GAOKAO Benchmark
por: Zhang, Xiaotian, et al.
Publicado: (2023)

ShizishanGPT: An Agricultural Large Language Model Integrating Tools and Resources
por: Yang, Shuting, et al.
Publicado: (2024)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
por: Zhang, Songming, et al.
Publicado: (2026)

FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models
por: Liu, Yan, et al.
Publicado: (2024)

An Empirical Analysis on Large Language Models in Debate Evaluation
por: Liu, Xinyi, et al.
Publicado: (2024)

Evaluating and Enhancing Large Language Models Performance in Domain-specific Medicine: Osteoarthritis Management with DocOA
por: Chen, Xi, et al.
Publicado: (2024)

LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation
por: Sun, Zengkui, et al.
Publicado: (2024)

VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Models
por: Yan, Yuchen, et al.
Publicado: (2025)

A Comprehensive Evaluation of Quantization Strategies for Large Language Models
por: Jin, Renren, et al.
Publicado: (2024)

Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger
por: Li, Wenjun, et al.
Publicado: (2025)

DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models
por: Huang, Yiming, et al.
Publicado: (2024)

CodeApex: A Bilingual Programming Evaluation Benchmark for Large Language Models
por: Fu, Lingyue, et al.
Publicado: (2023)