URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Base

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Khan, Aditya, Shipton, Mason, Anugraha, David, Duan, Kaiyao, Hoang, Phuong H., Khiu, Eric, Doğruöz, A. Seza, Lee, En-Shiun Annie
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913690113015808
author Khan, Aditya
Shipton, Mason
Anugraha, David
Duan, Kaiyao
Hoang, Phuong H.
Khiu, Eric
Doğruöz, A. Seza
Lee, En-Shiun Annie
author_facet Khan, Aditya
Shipton, Mason
Anugraha, David
Duan, Kaiyao
Hoang, Phuong H.
Khiu, Eric
Doğruöz, A. Seza
Lee, En-Shiun Annie
contents URIEL is a knowledge base offering geographical, phylogenetic, and typological vector representations for 7970 languages. It includes distance measures between these vectors for 4005 languages, which are accessible via the lang2vec tool. Despite being frequently cited, URIEL is limited in terms of linguistic inclusion and overall usability. To tackle these challenges, we introduce URIEL+, an enhanced version of URIEL and lang2vec that addresses these limitations. In addition to expanding typological feature coverage for 2898 languages, URIEL+ improves the user experience with robust, customizable distance calculations to better suit the needs of users. These upgrades also offer competitive performance on downstream tasks and provide distances that better align with linguistic distance studies.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18472
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Base
Khan, Aditya
Shipton, Mason
Anugraha, David
Duan, Kaiyao
Hoang, Phuong H.
Khiu, Eric
Doğruöz, A. Seza
Lee, En-Shiun Annie
Computation and Language
Machine Learning
URIEL is a knowledge base offering geographical, phylogenetic, and typological vector representations for 7970 languages. It includes distance measures between these vectors for 4005 languages, which are accessible via the lang2vec tool. Despite being frequently cited, URIEL is limited in terms of linguistic inclusion and overall usability. To tackle these challenges, we introduce URIEL+, an enhanced version of URIEL and lang2vec that addresses these limitations. In addition to expanding typological feature coverage for 2898 languages, URIEL+ improves the user experience with robust, customizable distance calculations to better suit the needs of users. These upgrades also offer competitive performance on downstream tasks and provide distances that better align with linguistic distance studies.
title URIEL+: Enhancing Linguistic Inclusion and Usability in a Typological and Multilingual Knowledge Base
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2409.18472