Learning to Seek Help: Dynamic Collaboration Between Small and Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910147043917824 |
|---|---|
| author | Zeng, Hang Liu, Xiangyu Hu, Yong Niu, Chaoyue Zhang, Jiarui Tang, Shaojie Wu, Fan Chen, Guihai |
| author_facet | Zeng, Hang Liu, Xiangyu Hu, Yong Niu, Chaoyue Zhang, Jiarui Tang, Shaojie Wu, Fan Chen, Guihai |
| contents | Large language models (LLMs) offer strong capabilities but raise cost and privacy concerns, whereas small language models (SLMs) facilitate efficient and private local inference yet suffer from limited capacity. To synergize the complementary strengths, we introduce a dynamic collaboration framework, where an SLM learns to proactively decide how to request an LLM during multi-step reasoning, while the LLM provides adaptive feedback instead of acting as a passive tool. We further systematically investigate how collaboration strategies are shaped by SLM and LLM capabilities as well as efficiency and privacy constraints. Evaluation results reveal a distinct scaling effect: stronger SLMs become more self-reliant, while stronger LLMs enable fewer and more informative interactions. In addition, the learned dynamic collaboration strategies significantly outperform static pipelines and standalone inference, and transfer robustly to unseen LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_17827 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Learning to Seek Help: Dynamic Collaboration Between Small and Large Language Models Zeng, Hang Liu, Xiangyu Hu, Yong Niu, Chaoyue Zhang, Jiarui Tang, Shaojie Wu, Fan Chen, Guihai Computation and Language Large language models (LLMs) offer strong capabilities but raise cost and privacy concerns, whereas small language models (SLMs) facilitate efficient and private local inference yet suffer from limited capacity. To synergize the complementary strengths, we introduce a dynamic collaboration framework, where an SLM learns to proactively decide how to request an LLM during multi-step reasoning, while the LLM provides adaptive feedback instead of acting as a passive tool. We further systematically investigate how collaboration strategies are shaped by SLM and LLM capabilities as well as efficiency and privacy constraints. Evaluation results reveal a distinct scaling effect: stronger SLMs become more self-reliant, while stronger LLMs enable fewer and more informative interactions. In addition, the learned dynamic collaboration strategies significantly outperform static pipelines and standalone inference, and transfer robustly to unseen LLMs. |
| title | Learning to Seek Help: Dynamic Collaboration Between Small and Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.17827 |