Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2603.12872 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917338533593088 |
|---|---|
| author | Silva, João Gomes, Luís Branco, António |
| author_facet | Silva, João Gomes, Luís Branco, António |
| contents | This paper reports on the development of a leaderboard of Open Large Language Models (LLM) for European Portuguese (PT-PT), and on its associated benchmarks. This leaderboard comes as a way to address a gap in the evaluation of LLM for European Portuguese, which so far had no leaderboard dedicated to this variant of the language. The paper also reports on novel benchmarks, including some that address aspects of performance that so far have not been available in benchmarks for European Portuguese, namely model safeguards and alignment to Portuguese culture. The leaderboard is available at https://huggingface.co/spaces/PORTULAN/portuguese-llm-leaderboard. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_12872 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CLARIN-PT-LDB: An Open LLM Leaderboard for Portuguese to assess Language, Culture and Civility Silva, João Gomes, Luís Branco, António Computation and Language This paper reports on the development of a leaderboard of Open Large Language Models (LLM) for European Portuguese (PT-PT), and on its associated benchmarks. This leaderboard comes as a way to address a gap in the evaluation of LLM for European Portuguese, which so far had no leaderboard dedicated to this variant of the language. The paper also reports on novel benchmarks, including some that address aspects of performance that so far have not been available in benchmarks for European Portuguese, namely model safeguards and alignment to Portuguese culture. The leaderboard is available at https://huggingface.co/spaces/PORTULAN/portuguese-llm-leaderboard. |
| title | CLARIN-PT-LDB: An Open LLM Leaderboard for Portuguese to assess Language, Culture and Civility |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2603.12872 |