HJ-Ky-0.1: an Evaluation Dataset for Kyrgyz Word Embeddings

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alekseev, Anton, Kabaeva, Gulnara
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929608226504704
author Alekseev, Anton
Kabaeva, Gulnara
author_facet Alekseev, Anton
Kabaeva, Gulnara
contents One of the key tasks in modern applied computational linguistics is constructing word vector representations (word embeddings), which are widely used to address natural language processing tasks such as sentiment analysis, information extraction, and more. To choose an appropriate method for generating these word embeddings, quality assessment techniques are often necessary. A standard approach involves calculating distances between vectors for words with expert-assessed 'similarity'. This work introduces the first 'silver standard' dataset for such tasks in the Kyrgyz language, alongside training corresponding models and validating the dataset's suitability through quality evaluation metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2411_10724
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HJ-Ky-0.1: an Evaluation Dataset for Kyrgyz Word Embeddings
Alekseev, Anton
Kabaeva, Gulnara
Computation and Language
One of the key tasks in modern applied computational linguistics is constructing word vector representations (word embeddings), which are widely used to address natural language processing tasks such as sentiment analysis, information extraction, and more. To choose an appropriate method for generating these word embeddings, quality assessment techniques are often necessary. A standard approach involves calculating distances between vectors for words with expert-assessed 'similarity'. This work introduces the first 'silver standard' dataset for such tasks in the Kyrgyz language, alongside training corresponding models and validating the dataset's suitability through quality evaluation metrics.
title HJ-Ky-0.1: an Evaluation Dataset for Kyrgyz Word Embeddings
topic Computation and Language
url https://arxiv.org/abs/2411.10724