LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916489407234048 |
|---|---|
| author | Carta, Salvatore Mario Chessa, Stefano Contu, Giulia Corriga, Andrea Deidda, Andrea Fenu, Gianni Frigau, Luca Giuliani, Alessandro Grassi, Luca Manca, Marco Manolo Marras, Mirko Mola, Francesco Mossa, Bastianino Mura, Piergiorgio Ortu, Marco Piano, Leonardo Pisano, Simone Pisu, Alessia Podda, Alessandro Sebastian Pompianu, Livio Seu, Simone Tiddia, Sandro Gabriele |
| author_facet | Carta, Salvatore Mario Chessa, Stefano Contu, Giulia Corriga, Andrea Deidda, Andrea Fenu, Gianni Frigau, Luca Giuliani, Alessandro Grassi, Luca Manca, Marco Manolo Marras, Mirko Mola, Francesco Mossa, Bastianino Mura, Piergiorgio Ortu, Marco Piano, Leonardo Pisano, Simone Pisu, Alessia Podda, Alessandro Sebastian Pompianu, Livio Seu, Simone Tiddia, Sandro Gabriele |
| contents | Minority languages are vital to preserving cultural heritage, yet they face growing risks of extinction due to limited digital resources and the dominance of artificial intelligence models trained on high-resource languages. This white paper proposes a framework to generate linguistic tools for low-resource languages, focusing on data creation to support the development of language models that can aid in preservation efforts. Sardinian, an endangered language, serves as the case study to demonstrate the framework's effectiveness. By addressing the data scarcity that hinders intelligent applications for such languages, we contribute to promoting linguistic diversity and support ongoing efforts in language standardization and revitalization through modern technologies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_13453 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models Carta, Salvatore Mario Chessa, Stefano Contu, Giulia Corriga, Andrea Deidda, Andrea Fenu, Gianni Frigau, Luca Giuliani, Alessandro Grassi, Luca Manca, Marco Manolo Marras, Mirko Mola, Francesco Mossa, Bastianino Mura, Piergiorgio Ortu, Marco Piano, Leonardo Pisano, Simone Pisu, Alessia Podda, Alessandro Sebastian Pompianu, Livio Seu, Simone Tiddia, Sandro Gabriele Computation and Language Artificial Intelligence Minority languages are vital to preserving cultural heritage, yet they face growing risks of extinction due to limited digital resources and the dominance of artificial intelligence models trained on high-resource languages. This white paper proposes a framework to generate linguistic tools for low-resource languages, focusing on data creation to support the development of language models that can aid in preservation efforts. Sardinian, an endangered language, serves as the case study to demonstrate the framework's effectiveness. By addressing the data scarcity that hinders intelligent applications for such languages, we contribute to promoting linguistic diversity and support ongoing efforts in language standardization and revitalization through modern technologies. |
| title | LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2411.13453 |