Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.17754 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909440878313472 |
|---|---|
| author | Zhang, Wei Zhang, Yi Zhu, Li Jia, Qianghuai Jiang, Feijun Guo, Hongcheng Li, Zhoujun Zhou, Mengping |
| author_facet | Zhang, Wei Zhang, Yi Zhu, Li Jia, Qianghuai Jiang, Feijun Guo, Hongcheng Li, Zhoujun Zhou, Mengping |
| contents | Large Language Models (LLMs) have made significant strides in Natural Language Processing and coding, yet they struggle with robustness and accuracy in complex function calls. To tackle these challenges, this paper introduces ADC, an innovative approach that enhances LLMs' ability to follow function formats and match complex parameters. ADC utilizes a high-quality code fine-tuning dataset with line-level execution feedback, providing granular process supervision that fosters strong logical reasoning and adherence to function formats. It also employs an adversarial dataset generation process to improve parameter matching. The staged training methodology capitalizes on both enriched code datasets and refined adversarial datasets, leading to marked improvements in function calling capabilities on the Berkeley Function-Calling Leaderboard (BFCL) Benchmark. The innovation of ADC lies in its strategic combination of process supervision, adversarial refinement, and incremental learning, setting a new standard for LLM proficiency in complex function calling. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17754 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ADC: Enhancing Function Calling Via Adversarial Datasets and Code Line-Level Feedback Zhang, Wei Zhang, Yi Zhu, Li Jia, Qianghuai Jiang, Feijun Guo, Hongcheng Li, Zhoujun Zhou, Mengping Software Engineering Large Language Models (LLMs) have made significant strides in Natural Language Processing and coding, yet they struggle with robustness and accuracy in complex function calls. To tackle these challenges, this paper introduces ADC, an innovative approach that enhances LLMs' ability to follow function formats and match complex parameters. ADC utilizes a high-quality code fine-tuning dataset with line-level execution feedback, providing granular process supervision that fosters strong logical reasoning and adherence to function formats. It also employs an adversarial dataset generation process to improve parameter matching. The staged training methodology capitalizes on both enriched code datasets and refined adversarial datasets, leading to marked improvements in function calling capabilities on the Berkeley Function-Calling Leaderboard (BFCL) Benchmark. The innovation of ADC lies in its strategic combination of process supervision, adversarial refinement, and incremental learning, setting a new standard for LLM proficiency in complex function calling. |
| title | ADC: Enhancing Function Calling Via Adversarial Datasets and Code Line-Level Feedback |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2412.17754 |