Neural Machine Translation for Malayalam Paraphrase Generation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Varghese, Christeena, Koshelev, Sergey, Yamshchikov, Ivan P.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909089364180992
author Varghese, Christeena
Koshelev, Sergey
Yamshchikov, Ivan P.
author_facet Varghese, Christeena
Koshelev, Sergey
Yamshchikov, Ivan P.
contents This study explores four methods of generating paraphrases in Malayalam, utilizing resources available for English paraphrasing and pre-trained Neural Machine Translation (NMT) models. We evaluate the resulting paraphrases using both automated metrics, such as BLEU, METEOR, and cosine similarity, as well as human annotation. Our findings suggest that automated evaluation measures may not be fully appropriate for Malayalam, as they do not consistently align with human judgment. This discrepancy underscores the need for more nuanced paraphrase evaluation approaches especially for highly agglutinative languages.
format Preprint
id arxiv_https___arxiv_org_abs_2401_17827
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Neural Machine Translation for Malayalam Paraphrase Generation
Varghese, Christeena
Koshelev, Sergey
Yamshchikov, Ivan P.
Computation and Language
Artificial Intelligence
I.7.0; I.2.7
This study explores four methods of generating paraphrases in Malayalam, utilizing resources available for English paraphrasing and pre-trained Neural Machine Translation (NMT) models. We evaluate the resulting paraphrases using both automated metrics, such as BLEU, METEOR, and cosine similarity, as well as human annotation. Our findings suggest that automated evaluation measures may not be fully appropriate for Malayalam, as they do not consistently align with human judgment. This discrepancy underscores the need for more nuanced paraphrase evaluation approaches especially for highly agglutinative languages.
title Neural Machine Translation for Malayalam Paraphrase Generation
topic Computation and Language
Artificial Intelligence
I.7.0; I.2.7
url https://arxiv.org/abs/2401.17827