Approaches to Semantic Textual Similarity in Slovak Language: From Algorithms to Transformers
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914305647050752 |
|---|---|
| author | Radosky, Lukas Blstak, Miroslav Krajcovic, Matej Polasek, Ivan |
| author_facet | Radosky, Lukas Blstak, Miroslav Krajcovic, Matej Polasek, Ivan |
| contents | Semantic textual similarity (STS) plays a crucial role in many natural language processing tasks. While extensively studied in high-resource languages, STS remains challenging for under-resourced languages such as Slovak. This paper presents a comparative evaluation of sentence-level STS methods applied to Slovak, including traditional algorithms, supervised machine learning models, and third-party deep learning tools. We trained several machine learning models using outputs from traditional algorithms as features, with feature selection and hyperparameter tuning jointly guided by artificial bee colony optimization. Finally, we evaluated several third-party tools, including fine-tuned model by CloudNLP, OpenAI's embedding models, GPT-4 model, and pretrained SlovakBERT model. Our findings highlight the trade-offs between different approaches. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_04659 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Approaches to Semantic Textual Similarity in Slovak Language: From Algorithms to Transformers Radosky, Lukas Blstak, Miroslav Krajcovic, Matej Polasek, Ivan Computation and Language 68T50 (Primary) 68T20, 68T05 (Secondary) I.2.6; I.2.7; I.2.8; I.5.2 Semantic textual similarity (STS) plays a crucial role in many natural language processing tasks. While extensively studied in high-resource languages, STS remains challenging for under-resourced languages such as Slovak. This paper presents a comparative evaluation of sentence-level STS methods applied to Slovak, including traditional algorithms, supervised machine learning models, and third-party deep learning tools. We trained several machine learning models using outputs from traditional algorithms as features, with feature selection and hyperparameter tuning jointly guided by artificial bee colony optimization. Finally, we evaluated several third-party tools, including fine-tuned model by CloudNLP, OpenAI's embedding models, GPT-4 model, and pretrained SlovakBERT model. Our findings highlight the trade-offs between different approaches. |
| title | Approaches to Semantic Textual Similarity in Slovak Language: From Algorithms to Transformers |
| topic | Computation and Language 68T50 (Primary) 68T20, 68T05 (Secondary) I.2.6; I.2.7; I.2.8; I.5.2 |
| url | https://arxiv.org/abs/2602.04659 |