Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Tengxiao, Wang, Zifeng, Miao, Jin, Hsu, I-Hung, Yan, Jun, Chen, Jiefeng, Han, Rujun, Xu, Fangyuan, Chen, Yanfei, Jiang, Ke, Daruki, Samira, Liang, Yi, Wang, William Yang, Pfister, Tomas, Lee, Chen-Yu
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2511.17006
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918212667441152
author Liu, Tengxiao
Wang, Zifeng
Miao, Jin
Hsu, I-Hung
Yan, Jun
Chen, Jiefeng
Han, Rujun
Xu, Fangyuan
Chen, Yanfei
Jiang, Ke
Daruki, Samira
Liang, Yi
Wang, William Yang
Pfister, Tomas
Lee, Chen-Yu
author_facet Liu, Tengxiao
Wang, Zifeng
Miao, Jin
Hsu, I-Hung
Yan, Jun
Chen, Jiefeng
Han, Rujun
Xu, Fangyuan
Chen, Yanfei
Jiang, Ke
Daruki, Samira
Liang, Yi
Wang, William Yang
Pfister, Tomas
Lee, Chen-Yu
contents Scaling test-time computation improves performance across different tasks on large language models (LLMs), which has also been extended to tool-augmented agents. For these agents, scaling involves not only "thinking" in tokens but also "acting" via tool calls. The number of tool calls directly bounds the agent's interaction with the external environment. However, we find that simply granting agents a larger tool-call budget fails to improve performance, as they lack "budget awareness" and quickly hit a performance ceiling. To address this, we study how to scale such agents effectively under explicit tool-call budgets, focusing on web search agents. We first introduce the Budget Tracker, a lightweight plug-in that provides the agent with continuous budget awareness, enabling simple yet effective scaling. We further develop BATS (Budget Aware Test-time Scaling), an advanced framework that leverages this awareness to dynamically adapt its planning and verification strategy, deciding whether to "dig deeper" on a promising lead or "pivot" to new paths based on remaining resources. To analyze cost-performance scaling in a controlled manner, we formalize a unified cost metric that jointly accounts for token and tool consumption. We provide the first systematic study on budget-constrained agents, showing that budget-aware methods produce more favorable scaling curves and push the cost-performance Pareto frontier. Our work offers empirical insights toward a more transparent and principled understanding of scaling in tool-augmented agents.
format Preprint
id arxiv_https___arxiv_org_abs_2511_17006
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Budget-Aware Tool-Use Enables Effective Agent Scaling
Liu, Tengxiao
Wang, Zifeng
Miao, Jin
Hsu, I-Hung
Yan, Jun
Chen, Jiefeng
Han, Rujun
Xu, Fangyuan
Chen, Yanfei
Jiang, Ke
Daruki, Samira
Liang, Yi
Wang, William Yang
Pfister, Tomas
Lee, Chen-Yu
Artificial Intelligence
Scaling test-time computation improves performance across different tasks on large language models (LLMs), which has also been extended to tool-augmented agents. For these agents, scaling involves not only "thinking" in tokens but also "acting" via tool calls. The number of tool calls directly bounds the agent's interaction with the external environment. However, we find that simply granting agents a larger tool-call budget fails to improve performance, as they lack "budget awareness" and quickly hit a performance ceiling. To address this, we study how to scale such agents effectively under explicit tool-call budgets, focusing on web search agents. We first introduce the Budget Tracker, a lightweight plug-in that provides the agent with continuous budget awareness, enabling simple yet effective scaling. We further develop BATS (Budget Aware Test-time Scaling), an advanced framework that leverages this awareness to dynamically adapt its planning and verification strategy, deciding whether to "dig deeper" on a promising lead or "pivot" to new paths based on remaining resources. To analyze cost-performance scaling in a controlled manner, we formalize a unified cost metric that jointly accounts for token and tool consumption. We provide the first systematic study on budget-constrained agents, showing that budget-aware methods produce more favorable scaling curves and push the cost-performance Pareto frontier. Our work offers empirical insights toward a more transparent and principled understanding of scaling in tool-augmented agents.
title Budget-Aware Tool-Use Enables Effective Agent Scaling
topic Artificial Intelligence
url https://arxiv.org/abs/2511.17006