Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910430361812992 |
|---|---|
| author | Srivatsa, KV Aditya Maurya, Kaushal Kumar Kochmar, Ekaterina |
| author_facet | Srivatsa, KV Aditya Maurya, Kaushal Kumar Kochmar, Ekaterina |
| contents | With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM routing for challenging reasoning tasks. Our extensive experiments suggest that such routing shows promise but is not feasible in all scenarios, so more robust approaches should be investigated to fill this gap. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_00467 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing Srivatsa, KV Aditya Maurya, Kaushal Kumar Kochmar, Ekaterina Computation and Language With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM routing for challenging reasoning tasks. Our extensive experiments suggest that such routing shows promise but is not feasible in all scenarios, so more robust approaches should be investigated to fill this gap. |
| title | Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.00467 |