Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Srivatsa, KV Aditya, Maurya, Kaushal Kumar, Kochmar, Ekaterina
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910430361812992
author Srivatsa, KV Aditya
Maurya, Kaushal Kumar
Kochmar, Ekaterina
author_facet Srivatsa, KV Aditya
Maurya, Kaushal Kumar
Kochmar, Ekaterina
contents With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM routing for challenging reasoning tasks. Our extensive experiments suggest that such routing shows promise but is not feasible in all scenarios, so more robust approaches should be investigated to fill this gap.
format Preprint
id arxiv_https___arxiv_org_abs_2405_00467
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing
Srivatsa, KV Aditya
Maurya, Kaushal Kumar
Kochmar, Ekaterina
Computation and Language
With the rapid development of LLMs, it is natural to ask how to harness their capabilities efficiently. In this paper, we explore whether it is feasible to direct each input query to a single most suitable LLM. To this end, we propose LLM routing for challenging reasoning tasks. Our extensive experiments suggest that such routing shows promise but is not feasible in all scenarios, so more robust approaches should be investigated to fill this gap.
title Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routing
topic Computation and Language
url https://arxiv.org/abs/2405.00467