Saved in:
Bibliographic Details
Main Authors: Li, Yuwen, Zhang, Wei, Huang, Zelong, Yang, Mason, Wu, Jiajun, Guo, Shawn, Hu, Huahao, Sun, Lingyi, Yang, Jian, Tang, Mingjie, Dai, Byran
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.23611
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Enabling Large Language Models (LLMs) to reliably invoke external tools remains a critical bottleneck for autonomous agents. Existing approaches suffer from three fundamental challenges: expensive human annotation for high-quality trajectories, poor generalization to unseen tools, and quality ceilings inherent in single-model synthesis that perpetuate biases and coverage gaps. We introduce InfTool, a fully autonomous framework that breaks these barriers through self-evolving multi-agent synthesis. Given only raw API specifications, InfTool orchestrates three collaborative agents (User Simulator, Tool-Calling Assistant, and MCP Server) to generate diverse, verified trajectories spanning single-turn calls to complex multi-step workflows. The framework establishes a closed loop: synthesized data trains the model via Group Relative Policy Optimization (GRPO) with gated rewards, the improved model generates higher-quality data targeting capability gaps, and this cycle iterates without human intervention. Experiments on the Berkeley Function-Calling Leaderboard (BFCL) demonstrate that InfTool transforms a base 32B model from 19.8% to 70.9% accuracy (+258%), surpassing models 10x larger and rivaling Claude-Opus, and entirely from synthetic data without human annotation.