Buchumschlag

When Do Tools and Planning Help Large Language Models Think? A Cost- and Latency-Aware Benchmark

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Ghoshal, Subha, Al-Bustami, Ali
Format:	Preprint
Veröffentlicht:	2026
Schlagworte:	Computation and Language Artificial Intelligence
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Do Thinking Tokens Help or Trap? Towards More Efficient Large Reasoning Model
von: Ding, Bowen, et al.
Veröffentlicht: (2025)

Cognitive Decision Routing in Large Language Models: When to Think Fast, When to Think Slow
von: Du, Y., et al.
Veröffentlicht: (2025)

The Cost of Thinking: Increased Jailbreak Risk in Large Language Models
von: Yang, Fan
Veröffentlicht: (2025)

When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
von: Zheng, Mingqian, et al.
Veröffentlicht: (2023)

A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gap
von: Khan, Sheraz, et al.
Veröffentlicht: (2025)

Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmark
von: Zhang, Hanlei, et al.
Veröffentlicht: (2025)

ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models
von: Zhang, Yuxiang, et al.
Veröffentlicht: (2024)

UrbanPlanBench: A Comprehensive Urban Planning Benchmark for Evaluating Large Language Models
von: Zheng, Yu, et al.
Veröffentlicht: (2025)

WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models
von: Ning, Kangyun, et al.
Veröffentlicht: (2024)

When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models
von: Zheng, Yingming, et al.
Veröffentlicht: (2025)

Learning When to Think While Listening in Large Audio-Language Models
von: Song, Zhiyuan, et al.
Veröffentlicht: (2026)

Modeling Hierarchical Thinking in Large Reasoning Models
von: Shahariar, G M, et al.
Veröffentlicht: (2025)

BALSAM: A Platform for Benchmarking Arabic Large Language Models
von: Al-Matham, Rawan, et al.
Veröffentlicht: (2025)

Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models
von: Shi, Zhengliang, et al.
Veröffentlicht: (2025)

Aware First, Think Less: Dynamic Boundary Self-Awareness Drives Extreme Reasoning Efficiency in Large Language Models
von: Chen, Qiguang, et al.
Veröffentlicht: (2025)

Beyond English-Centric LLMs: What Language Do Multilingual Language Models Think in?
von: Zhong, Chengzhi, et al.
Veröffentlicht: (2024)

HonestLLM: Toward an Honest and Helpful Large Language Model
von: Gao, Chujie, et al.
Veröffentlicht: (2024)

Learning How to Use Tools, Not Just When: Pattern-Aware Tool-Integrated Reasoning
von: Xu, Ningning, et al.
Veröffentlicht: (2025)

EconCausal: A Context-Aware Economic Reasoning Benchmark for Large Language Models
von: Lee, Donggyu, et al.
Veröffentlicht: (2025)

RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning
von: Ye, Junjie, et al.
Veröffentlicht: (2024)

Exploring and Benchmarking the Planning Capabilities of Large Language Models
von: Bohnet, Bernd, et al.
Veröffentlicht: (2024)

Chain of Thought Still Thinks Fast: APriCoT Helps with Thinking Slow
von: Moore, Kyle, et al.
Veröffentlicht: (2024)

Leveraging Computerized Adaptive Testing for Cost-effective Evaluation of Large Language Models in Medical Benchmarking
von: Zheng, Tianpeng, et al.
Veröffentlicht: (2026)

CASE-Bench: Context-Aware SafEty Benchmark for Large Language Models
von: Sun, Guangzhi, et al.
Veröffentlicht: (2025)

Time Awareness in Large Language Models: Benchmarking Fact Recall Across Time
von: Herel, David, et al.
Veröffentlicht: (2024)

ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models
von: Hijazi, Faris, et al.
Veröffentlicht: (2024)

TreeEval: Benchmark-Free Evaluation of Large Language Models through Tree Planning
von: Li, Xiang, et al.
Veröffentlicht: (2024)

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards
von: Alzahrani, Norah, et al.
Veröffentlicht: (2024)

When Can Large Reasoning Models Save Thinking? Mechanistic Analysis of Behavioral Divergence in Reasoning
von: Zhu, Rongzhi, et al.
Veröffentlicht: (2025)

Do Retrieval Augmented Language Models Know When They Don't Know?
von: Zhou, Youchao, et al.
Veröffentlicht: (2025)

Do Language Models Know When They're Hallucinating References?
von: Agrawal, Ayush, et al.
Veröffentlicht: (2023)

Importance Weighting Can Help Large Language Models Self-Improve
von: Jiang, Chunyang, et al.
Veröffentlicht: (2024)

Tool Learning with Large Language Models: A Survey
von: Qu, Changle, et al.
Veröffentlicht: (2024)

A Survey of Large Language Models for Arabic Language and its Dialects
von: Mashaabi, Malak, et al.
Veröffentlicht: (2024)

When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviour
von: Ranaldi, Leonardo, et al.
Veröffentlicht: (2023)

Chat2SPaT: A Large Language Model Based Tool for Automating Traffic Signal Control Plan Management
von: Wang, Yue, et al.
Veröffentlicht: (2025)

Can Large Language Models Predict the Outcome of Judicial Decisions?
von: Kmainasi, Mohamed Bayan, et al.
Veröffentlicht: (2025)

ToolNet: Connecting Large Language Models with Massive Tools via Tool Graph
von: Liu, Xukun, et al.
Veröffentlicht: (2024)

ToolSpectrum : Towards Personalized Tool Utilization for Large Language Models
von: Cheng, Zihao, et al.
Veröffentlicht: (2025)

Multi-Persona Thinking for Bias Mitigation in Large Language Models
von: Chen, Yuxing, et al.
Veröffentlicht: (2026)