ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918218988257280 |
|---|---|
| author | Su, Hongjin Diao, Shizhe Lu, Ximing Liu, Mingjie Xu, Jiacheng Dong, Xin Fu, Yonggan Belcak, Peter Ye, Hanrong Yin, Hongxu Dong, Yi Bakhturina, Evelina Yu, Tao Choi, Yejin Kautz, Jan Molchanov, Pavlo |
| author_facet | Su, Hongjin Diao, Shizhe Lu, Ximing Liu, Mingjie Xu, Jiacheng Dong, Xin Fu, Yonggan Belcak, Peter Ye, Hanrong Yin, Hongxu Dong, Yi Bakhturina, Evelina Yu, Tao Choi, Yejin Kautz, Jan Molchanov, Pavlo |
| contents | Large language models are powerful generalists, yet solving deep and complex problems such as those of the Humanity's Last Exam (HLE) remains both conceptually challenging and computationally expensive. We show that small orchestrators managing other models and a variety of tools can both push the upper bound of intelligence and improve efficiency in solving difficult agentic tasks. We introduce ToolOrchestra, a method for training small orchestrators that coordinate intelligent tools. ToolOrchestra explicitly uses reinforcement learning with outcome-, efficiency-, and user-preference-aware rewards. Using ToolOrchestra, we produce Orchestrator, an 8B model that achieves higher accuracy at lower cost than previous tool-use agents while aligning with user preferences on which tools are to be used for a given query. On HLE, Orchestrator achieves a score of 37.1%, outperforming GPT-5 (35.1%) while being 2.5x more efficient. On tau2-Bench and FRAMES, Orchestrator surpasses GPT-5 by a wide margin while using only about 30% of the cost. Extensive analysis shows that Orchestrator achieves the best trade-off between performance and cost under multiple metrics, and generalizes robustly to unseen tools. These results demonstrate that composing diverse tools with a lightweight orchestration model is both more efficient and more effective than existing methods, paving the way for practical and scalable tool-augmented reasoning systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_21689 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration Su, Hongjin Diao, Shizhe Lu, Ximing Liu, Mingjie Xu, Jiacheng Dong, Xin Fu, Yonggan Belcak, Peter Ye, Hanrong Yin, Hongxu Dong, Yi Bakhturina, Evelina Yu, Tao Choi, Yejin Kautz, Jan Molchanov, Pavlo Computation and Language Artificial Intelligence Machine Learning Multiagent Systems Large language models are powerful generalists, yet solving deep and complex problems such as those of the Humanity's Last Exam (HLE) remains both conceptually challenging and computationally expensive. We show that small orchestrators managing other models and a variety of tools can both push the upper bound of intelligence and improve efficiency in solving difficult agentic tasks. We introduce ToolOrchestra, a method for training small orchestrators that coordinate intelligent tools. ToolOrchestra explicitly uses reinforcement learning with outcome-, efficiency-, and user-preference-aware rewards. Using ToolOrchestra, we produce Orchestrator, an 8B model that achieves higher accuracy at lower cost than previous tool-use agents while aligning with user preferences on which tools are to be used for a given query. On HLE, Orchestrator achieves a score of 37.1%, outperforming GPT-5 (35.1%) while being 2.5x more efficient. On tau2-Bench and FRAMES, Orchestrator surpasses GPT-5 by a wide margin while using only about 30% of the cost. Extensive analysis shows that Orchestrator achieves the best trade-off between performance and cost under multiple metrics, and generalizes robustly to unseen tools. These results demonstrate that composing diverse tools with a lightweight orchestration model is both more efficient and more effective than existing methods, paving the way for practical and scalable tool-augmented reasoning systems. |
| title | ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration |
| topic | Computation and Language Artificial Intelligence Machine Learning Multiagent Systems |
| url | https://arxiv.org/abs/2511.21689 |