NusaAksara: A Multimodal and Multilingual Benchmark for Preserving Indonesian Indigenous Scripts
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911092643463168 |
|---|---|
| author | Adilazuarda, Muhammad Farid Wijanarko, Musa Izzanardi Susanto, Lucky Nur'aini, Khumaisa Wijaya, Derry Aji, Alham Fikri |
| author_facet | Adilazuarda, Muhammad Farid Wijanarko, Musa Izzanardi Susanto, Lucky Nur'aini, Khumaisa Wijaya, Derry Aji, Alham Fikri |
| contents | Indonesia is rich in languages and scripts. However, most NLP progress has been made using romanized text. In this paper, we present NusaAksara, a novel public benchmark for Indonesian languages that includes their original scripts. Our benchmark covers both text and image modalities and encompasses diverse tasks such as image segmentation, OCR, transliteration, translation, and language identification. Our data is constructed by human experts through rigorous steps. NusaAksara covers 8 scripts across 7 languages, including low-resource languages not commonly seen in NLP benchmarks. Although unsupported by Unicode, the Lampung script is included in this dataset. We benchmark our data across several models, from LLMs and VLMs such as GPT-4o, Llama 3.2, and Aya 23 to task-specific systems such as PP-OCR and LangID, and show that most NLP technologies cannot handle Indonesia's local scripts, with many achieving near-zero performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_18148 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NusaAksara: A Multimodal and Multilingual Benchmark for Preserving Indonesian Indigenous Scripts Adilazuarda, Muhammad Farid Wijanarko, Musa Izzanardi Susanto, Lucky Nur'aini, Khumaisa Wijaya, Derry Aji, Alham Fikri Computation and Language Artificial Intelligence Machine Learning Indonesia is rich in languages and scripts. However, most NLP progress has been made using romanized text. In this paper, we present NusaAksara, a novel public benchmark for Indonesian languages that includes their original scripts. Our benchmark covers both text and image modalities and encompasses diverse tasks such as image segmentation, OCR, transliteration, translation, and language identification. Our data is constructed by human experts through rigorous steps. NusaAksara covers 8 scripts across 7 languages, including low-resource languages not commonly seen in NLP benchmarks. Although unsupported by Unicode, the Lampung script is included in this dataset. We benchmark our data across several models, from LLMs and VLMs such as GPT-4o, Llama 3.2, and Aya 23 to task-specific systems such as PP-OCR and LangID, and show that most NLP technologies cannot handle Indonesia's local scripts, with many achieving near-zero performance. |
| title | NusaAksara: A Multimodal and Multilingual Benchmark for Preserving Indonesian Indigenous Scripts |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2502.18148 |