Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.04699 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916769945354240 |
|---|---|
| author | Sankar, Ashwin Jain, Sparsh Narasimhan, Nikhil Choudhary, Devilal Suman, Dhairya Khan, Mohammed Safi Ur Rahman Kunchukuttan, Anoop Khapra, Mitesh M Dabre, Raj |
| author_facet | Sankar, Ashwin Jain, Sparsh Narasimhan, Nikhil Choudhary, Devilal Suman, Dhairya Khan, Mohammed Safi Ur Rahman Kunchukuttan, Anoop Khapra, Mitesh M Dabre, Raj |
| contents | Speech translation for Indian languages remains a challenging task due to the scarcity of large-scale, publicly available datasets that capture the linguistic diversity and domain coverage essential for real-world applications. Existing datasets cover a fraction of Indian languages and lack the breadth needed to train robust models that generalize beyond curated benchmarks. To bridge this gap, we introduce BhasaAnuvaad, the largest speech translation dataset for Indian languages, spanning over 44 thousand hours of audio and 17 million aligned text segments across 14 Indian languages and English. Our dataset is built through a threefold methodology: (a) aggregating high-quality existing sources, (b) large-scale web crawling to ensure linguistic and domain diversity, and (c) creating synthetic data to model real-world speech disfluencies. Leveraging BhasaAnuvaad, we train IndicSeamless, a state-of-the-art speech translation model for Indian languages that performs better than existing models. Our experiments demonstrate improvements in the translation quality, setting a new standard for Indian language speech translation. We will release all the code, data and model weights in the open-source, with permissive licenses to promote accessibility and collaboration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_04699 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages Sankar, Ashwin Jain, Sparsh Narasimhan, Nikhil Choudhary, Devilal Suman, Dhairya Khan, Mohammed Safi Ur Rahman Kunchukuttan, Anoop Khapra, Mitesh M Dabre, Raj Computation and Language Speech translation for Indian languages remains a challenging task due to the scarcity of large-scale, publicly available datasets that capture the linguistic diversity and domain coverage essential for real-world applications. Existing datasets cover a fraction of Indian languages and lack the breadth needed to train robust models that generalize beyond curated benchmarks. To bridge this gap, we introduce BhasaAnuvaad, the largest speech translation dataset for Indian languages, spanning over 44 thousand hours of audio and 17 million aligned text segments across 14 Indian languages and English. Our dataset is built through a threefold methodology: (a) aggregating high-quality existing sources, (b) large-scale web crawling to ensure linguistic and domain diversity, and (c) creating synthetic data to model real-world speech disfluencies. Leveraging BhasaAnuvaad, we train IndicSeamless, a state-of-the-art speech translation model for Indian languages that performs better than existing models. Our experiments demonstrate improvements in the translation quality, setting a new standard for Indian language speech translation. We will release all the code, data and model weights in the open-source, with permissive licenses to promote accessibility and collaboration. |
| title | Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2411.04699 |