The Tool Illusion: Rethinking Tool Use in Web Agents
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917383789084672 |
|---|---|
| author | Lou, Renze Peng, Baolin Yao, Wenlin Wu, Qianhui Cheng, Hao Nath, Suman Yin, Wenpeng Gao, Jianfeng |
| author_facet | Lou, Renze Peng, Baolin Yao, Wenlin Wu, Qianhui Cheng, Hao Nath, Suman Yin, Wenpeng Gao, Jianfeng |
| contents | As web agents rapidly evolve, an increasing body of work has moved beyond conventional atomic browser interactions and explored tool use as a higher-level action paradigm. Although prior studies have shown the promise of tools, their conclusions are often drawn from limited experimental scales and sometimes non-comparable settings. As a result, several fundamental questions remain unclear: i) whether tools provide consistent gains for web agents, ii) what practical design principles characterize effective tools, and iii) what side effects tool use may introduce. To establish a stronger empirical foundation for future research, we revisit tool use in web agents through an extensive and carefully controlled study across diverse tool sources, backbone models, tool-use frameworks, and evaluation benchmarks. Our findings both revise some prior conclusions and complement others with broader evidence. We hope this study provides a more reliable empirical basis and inspires future research on tool-use web agents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_03465 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | The Tool Illusion: Rethinking Tool Use in Web Agents Lou, Renze Peng, Baolin Yao, Wenlin Wu, Qianhui Cheng, Hao Nath, Suman Yin, Wenpeng Gao, Jianfeng Computation and Language As web agents rapidly evolve, an increasing body of work has moved beyond conventional atomic browser interactions and explored tool use as a higher-level action paradigm. Although prior studies have shown the promise of tools, their conclusions are often drawn from limited experimental scales and sometimes non-comparable settings. As a result, several fundamental questions remain unclear: i) whether tools provide consistent gains for web agents, ii) what practical design principles characterize effective tools, and iii) what side effects tool use may introduce. To establish a stronger empirical foundation for future research, we revisit tool use in web agents through an extensive and carefully controlled study across diverse tool sources, backbone models, tool-use frameworks, and evaluation benchmarks. Our findings both revise some prior conclusions and complement others with broader evidence. We hope this study provides a more reliable empirical basis and inspires future research on tool-use web agents. |
| title | The Tool Illusion: Rethinking Tool Use in Web Agents |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.03465 |