MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916165902663680 |
|---|---|
| author | Peng, Yifan Kulikov, Ilia Yang, Yilin Popuri, Sravya Lu, Hui Wang, Changhan Gong, Hongyu |
| author_facet | Peng, Yifan Kulikov, Ilia Yang, Yilin Popuri, Sravya Lu, Hui Wang, Changhan Gong, Hongyu |
| contents | There have been emerging research interest and advances in speech-to-speech translation (S2ST), translating utterances from one language to another. This work proposes Multitask Speech Language Model (MSLM), which is a decoder-only speech language model trained in a multitask setting. Without reliance on text training data, our model is able to support multilingual S2ST with speaker style preserved. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_12408 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation Peng, Yifan Kulikov, Ilia Yang, Yilin Popuri, Sravya Lu, Hui Wang, Changhan Gong, Hongyu Computation and Language Sound Audio and Speech Processing There have been emerging research interest and advances in speech-to-speech translation (S2ST), translating utterances from one language to another. This work proposes Multitask Speech Language Model (MSLM), which is a decoder-only speech language model trained in a multitask setting. Without reliance on text training data, our model is able to support multilingual S2ST with speaker style preserved. |
| title | MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2403.12408 |