Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qiu, Xiaoyu, Wang, Yuechen, Shi, Jiaxin, Zhou, Wengang, Li, Houqiang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929282072182784
author Qiu, Xiaoyu
Wang, Yuechen
Shi, Jiaxin
Zhou, Wengang
Li, Houqiang
author_facet Qiu, Xiaoyu
Wang, Yuechen
Shi, Jiaxin
Zhou, Wengang
Li, Houqiang
contents Based on multilingual pre-trained models, cross-lingual transfer with prompt learning has shown promising effectiveness, where soft prompt learned in a source language is transferred to target languages for downstream tasks, particularly in the low-resource scenario. To efficiently transfer soft prompt, we propose a novel framework, Multilingual Prompt Translator (MPT), where a multilingual prompt translator is introduced to properly process crucial knowledge embedded in prompt by changing language knowledge while retaining task knowledge. Concretely, we first train prompt in source language and employ translator to translate it into target prompt. Besides, we extend an external corpus as auxiliary data, on which an alignment task for predicted answer probability is designed to convert language knowledge, thereby equipping target prompt with multilingual knowledge. In few-shot settings on XNLI, MPT demonstrates superiority over baselines by remarkable improvements. MPT is more prominent compared with vanilla prompting when transferring to languages quite distinct from source language.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12407
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator
Qiu, Xiaoyu
Wang, Yuechen
Shi, Jiaxin
Zhou, Wengang
Li, Houqiang
Computation and Language
Based on multilingual pre-trained models, cross-lingual transfer with prompt learning has shown promising effectiveness, where soft prompt learned in a source language is transferred to target languages for downstream tasks, particularly in the low-resource scenario. To efficiently transfer soft prompt, we propose a novel framework, Multilingual Prompt Translator (MPT), where a multilingual prompt translator is introduced to properly process crucial knowledge embedded in prompt by changing language knowledge while retaining task knowledge. Concretely, we first train prompt in source language and employ translator to translate it into target prompt. Besides, we extend an external corpus as auxiliary data, on which an alignment task for predicted answer probability is designed to convert language knowledge, thereby equipping target prompt with multilingual knowledge. In few-shot settings on XNLI, MPT demonstrates superiority over baselines by remarkable improvements. MPT is more prominent compared with vanilla prompting when transferring to languages quite distinct from source language.
title Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator
topic Computation and Language
url https://arxiv.org/abs/2403.12407