Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Wooyoung, Jo, Chaerin, Kim, Minjung, Kim, Wooju
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916258047328256
author Kim, Wooyoung
Jo, Chaerin
Kim, Minjung
Kim, Wooju
author_facet Kim, Wooyoung
Jo, Chaerin
Kim, Minjung
Kim, Wooju
contents As for multilingual language models, it is important to select languages for training because of the curse of multilinguality. It is known that using languages with similar language structures is effective for cross lingual transfer learning. However, we demonstrate that using agglutinative languages such as Korean is more effective in cross lingual transfer learning. This is a great discovery that will change the training strategy of cross lingual transfer learning.
format Preprint
id arxiv_https___arxiv_org_abs_2204_03831
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning
Kim, Wooyoung
Jo, Chaerin
Kim, Minjung
Kim, Wooju
Computation and Language
As for multilingual language models, it is important to select languages for training because of the curse of multilinguality. It is known that using languages with similar language structures is effective for cross lingual transfer learning. However, we demonstrate that using agglutinative languages such as Korean is more effective in cross lingual transfer learning. This is a great discovery that will change the training strategy of cross lingual transfer learning.
title Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning
topic Computation and Language
url https://arxiv.org/abs/2204.03831