Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.14432 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915338631774208 |
|---|---|
| author | Fang, Wei Zhang, Yang Qian, Kaizhi Glass, James Zhu, Yada |
| author_facet | Fang, Wei Zhang, Yang Qian, Kaizhi Glass, James Zhu, Yada |
| contents | Large language models (LLMs) are increasingly integrated with specialized external tools, yet many tasks demand zero-shot tool usage with minimal or noisy documentation. Existing solutions rely on manual rewriting or labeled data for validation, making them inapplicable in true zero-shot settings. To address these challenges, we propose PLAY2PROMPT, an automated framework that systematically "plays" with each tool to explore its input-output behaviors. Through this iterative trial-and-error process, PLAY2PROMPT refines tool documentation and generates usage examples without any labeled data. These examples not only guide LLM inference but also serve as validation to further enhance tool utilization. Extensive experiments on real-world tasks demonstrate that PLAY2PROMPT significantly improves zero-shot tool performance across both open and closed models, offering a scalable and effective solution for domain-specific tool integration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_14432 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PLAY2PROMPT: Zero-shot Tool Instruction Optimization for LLM Agents via Tool Play Fang, Wei Zhang, Yang Qian, Kaizhi Glass, James Zhu, Yada Computation and Language Artificial Intelligence Machine Learning Large language models (LLMs) are increasingly integrated with specialized external tools, yet many tasks demand zero-shot tool usage with minimal or noisy documentation. Existing solutions rely on manual rewriting or labeled data for validation, making them inapplicable in true zero-shot settings. To address these challenges, we propose PLAY2PROMPT, an automated framework that systematically "plays" with each tool to explore its input-output behaviors. Through this iterative trial-and-error process, PLAY2PROMPT refines tool documentation and generates usage examples without any labeled data. These examples not only guide LLM inference but also serve as validation to further enhance tool utilization. Extensive experiments on real-world tasks demonstrate that PLAY2PROMPT significantly improves zero-shot tool performance across both open and closed models, offering a scalable and effective solution for domain-specific tool integration. |
| title | PLAY2PROMPT: Zero-shot Tool Instruction Optimization for LLM Agents via Tool Play |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2503.14432 |