What Are Tools Anyway? A Survey from the Language Model Perspective
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929286491930624 |
|---|---|
| author | Wang, Zhiruo Cheng, Zhoujun Zhu, Hao Fried, Daniel Neubig, Graham |
| author_facet | Wang, Zhiruo Cheng, Zhoujun Zhu, Hao Fried, Daniel Neubig, Graham |
| contents | Language models (LMs) are powerful yet mostly for text generation tasks. Tools have substantially enhanced their performance for tasks that require complex skills. However, many works adopt the term "tool" in different ways, raising the question: What is a tool anyway? Subsequently, where and how do tools help LMs? In this survey, we provide a unified definition of tools as external programs used by LMs, and perform a systematic review of LM tooling scenarios and approaches. Grounded on this review, we empirically study the efficiency of various tooling methods by measuring their required compute and performance gains on various benchmarks, and highlight some challenges and potential future research in the field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_15452 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | What Are Tools Anyway? A Survey from the Language Model Perspective Wang, Zhiruo Cheng, Zhoujun Zhu, Hao Fried, Daniel Neubig, Graham Computation and Language Artificial Intelligence Language models (LMs) are powerful yet mostly for text generation tasks. Tools have substantially enhanced their performance for tasks that require complex skills. However, many works adopt the term "tool" in different ways, raising the question: What is a tool anyway? Subsequently, where and how do tools help LMs? In this survey, we provide a unified definition of tools as external programs used by LMs, and perform a systematic review of LM tooling scenarios and approaches. Grounded on this review, we empirically study the efficiency of various tooling methods by measuring their required compute and performance gains on various benchmarks, and highlight some challenges and potential future research in the field. |
| title | What Are Tools Anyway? A Survey from the Language Model Perspective |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2403.15452 |