La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912943617081344 |
|---|---|
| author | Grandury, María Aula-Blasco, Javier Falcão, Júlia Fourrier, Clémentine González, Miguel Martínez, Gonzalo Santamaría, Gonzalo Agerri, Rodrigo Aldama, Nuria Chiruzzo, Luis Conde, Javier Gómez, Helena Guerrero, Marta Ivetta, Guido López, Natalia Plaza-del-Arco, Flor Miriam Martín-Valdivia, María Teresa Montoro, Helena Muñoz, Carmen Reviriego, Pedro Rosado, Leire Vaca, Alejandro Vallecillo-Rodríguez, María Estrella Vallego, Jorge Zubiaga, Irune |
| author_facet | Grandury, María Aula-Blasco, Javier Falcão, Júlia Fourrier, Clémentine González, Miguel Martínez, Gonzalo Santamaría, Gonzalo Agerri, Rodrigo Aldama, Nuria Chiruzzo, Luis Conde, Javier Gómez, Helena Guerrero, Marta Ivetta, Guido López, Natalia Plaza-del-Arco, Flor Miriam Martín-Valdivia, María Teresa Montoro, Helena Muñoz, Carmen Reviriego, Pedro Rosado, Leire Vaca, Alejandro Vallecillo-Rodríguez, María Estrella Vallego, Jorge Zubiaga, Irune |
| contents | Leaderboards showcase the current capabilities and limitations of Large Language Models (LLMs). To motivate the development of LLMs that represent the linguistic and cultural diversity of the Spanish-speaking community, we present La Leaderboard, the first open-source leaderboard to evaluate generative LLMs in languages and language varieties of Spain and Latin America. La Leaderboard is a community-driven project that aims to establish an evaluation standard for everyone interested in developing LLMs for the Spanish-speaking community. This initial version combines 66 datasets in Basque, Catalan, Galician, and different Spanish varieties, showcasing the evaluation results of 50 models. To encourage community-driven development of leaderboards in other languages, we explain our methodology, including guidance on selecting the most suitable evaluation setup for each downstream task. In particular, we provide a rationale for using fewer few-shot examples than typically found in the literature, aiming to reduce environmental impact and facilitate access to reproducible results for a broader research community. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_00999 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America Grandury, María Aula-Blasco, Javier Falcão, Júlia Fourrier, Clémentine González, Miguel Martínez, Gonzalo Santamaría, Gonzalo Agerri, Rodrigo Aldama, Nuria Chiruzzo, Luis Conde, Javier Gómez, Helena Guerrero, Marta Ivetta, Guido López, Natalia Plaza-del-Arco, Flor Miriam Martín-Valdivia, María Teresa Montoro, Helena Muñoz, Carmen Reviriego, Pedro Rosado, Leire Vaca, Alejandro Vallecillo-Rodríguez, María Estrella Vallego, Jorge Zubiaga, Irune Computation and Language Leaderboards showcase the current capabilities and limitations of Large Language Models (LLMs). To motivate the development of LLMs that represent the linguistic and cultural diversity of the Spanish-speaking community, we present La Leaderboard, the first open-source leaderboard to evaluate generative LLMs in languages and language varieties of Spain and Latin America. La Leaderboard is a community-driven project that aims to establish an evaluation standard for everyone interested in developing LLMs for the Spanish-speaking community. This initial version combines 66 datasets in Basque, Catalan, Galician, and different Spanish varieties, showcasing the evaluation results of 50 models. To encourage community-driven development of leaderboards in other languages, we explain our methodology, including guidance on selecting the most suitable evaluation setup for each downstream task. In particular, we provide a rationale for using fewer few-shot examples than typically found in the literature, aiming to reduce environmental impact and facilitate access to reproducible results for a broader research community. |
| title | La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.00999 |