Enhancing LLM Tool Use with High-quality Instruction Data from Knowledge Graph
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915359908429824 |
|---|---|
| author | Wang, Jingwei Zhang, Zai Qian, Hao Gan, Chunjing Hu, Binbin Liu, Ziqi Zhang, Zhiqiang Zhou, Jun Shi, Bin Dong, Bo |
| author_facet | Wang, Jingwei Zhang, Zai Qian, Hao Gan, Chunjing Hu, Binbin Liu, Ziqi Zhang, Zhiqiang Zhou, Jun Shi, Bin Dong, Bo |
| contents | Teaching large language models (LLMs) to use tools is crucial for improving their problem-solving abilities and expanding their applications. However, effectively using tools is challenging because it requires a deep understanding of tool functionalities and user intentions. Previous methods relied mainly on LLMs to generate instruction data, but the quality of these data was often insufficient. In this paper, we propose a new method that uses knowledge graphs to generate high-quality instruction data for LLMs. Knowledge graphs are manually curated datasets rich in semantic information. We begin by extracting various query pathways from a given knowledge graph, which are transformed into a broad spectrum of user queries. We then translate the relationships between entities into actionable tools and parse the pathways of each query into detailed solution steps, thereby creating high-quality instruction data. Our experiments show that fine-tuning on just a small sample of this synthetic data can significantly improve the tool utilization and overall capabilities of LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_21071 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Enhancing LLM Tool Use with High-quality Instruction Data from Knowledge Graph Wang, Jingwei Zhang, Zai Qian, Hao Gan, Chunjing Hu, Binbin Liu, Ziqi Zhang, Zhiqiang Zhou, Jun Shi, Bin Dong, Bo Machine Learning Computation and Language Teaching large language models (LLMs) to use tools is crucial for improving their problem-solving abilities and expanding their applications. However, effectively using tools is challenging because it requires a deep understanding of tool functionalities and user intentions. Previous methods relied mainly on LLMs to generate instruction data, but the quality of these data was often insufficient. In this paper, we propose a new method that uses knowledge graphs to generate high-quality instruction data for LLMs. Knowledge graphs are manually curated datasets rich in semantic information. We begin by extracting various query pathways from a given knowledge graph, which are transformed into a broad spectrum of user queries. We then translate the relationships between entities into actionable tools and parse the pathways of each query into detailed solution steps, thereby creating high-quality instruction data. Our experiments show that fine-tuning on just a small sample of this synthetic data can significantly improve the tool utilization and overall capabilities of LLMs. |
| title | Enhancing LLM Tool Use with High-quality Instruction Data from Knowledge Graph |
| topic | Machine Learning Computation and Language |
| url | https://arxiv.org/abs/2506.21071 |