Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.01926 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911788590694400 |
|---|---|
| author | Javed, Tahir Nawale, Janki Atul George, Eldho Ittan Joshi, Sakshi Bhogale, Kaushal Santosh Mehendale, Deovrat Sethi, Ishvinder Virender Ananthanarayanan, Aparna Faquih, Hafsah Palit, Pratiti Ravishankar, Sneha Sukumaran, Saranya Panchagnula, Tripura Murali, Sunjay Gandhi, Kunal Sharad R, Ambujavalli M, Manickam K Vaijayanthi, C Venkata Karunganni, Krishnan Srinivasa Raghavan Kumar, Pratyush Khapra, Mitesh M |
| author_facet | Javed, Tahir Nawale, Janki Atul George, Eldho Ittan Joshi, Sakshi Bhogale, Kaushal Santosh Mehendale, Deovrat Sethi, Ishvinder Virender Ananthanarayanan, Aparna Faquih, Hafsah Palit, Pratiti Ravishankar, Sneha Sukumaran, Saranya Panchagnula, Tripura Murali, Sunjay Gandhi, Kunal Sharad R, Ambujavalli M, Manickam K Vaijayanthi, C Venkata Karunganni, Krishnan Srinivasa Raghavan Kumar, Pratyush Khapra, Mitesh M |
| contents | We present INDICVOICES, a dataset of natural and spontaneous speech containing a total of 7348 hours of read (9%), extempore (74%) and conversational (17%) audio from 16237 speakers covering 145 Indian districts and 22 languages. Of these 7348 hours, 1639 hours have already been transcribed, with a median of 73 hours per language. Through this paper, we share our journey of capturing the cultural, linguistic and demographic diversity of India to create a one-of-its-kind inclusive and representative dataset. More specifically, we share an open-source blueprint for data collection at scale comprising of standardised protocols, centralised tools, a repository of engaging questions, prompts and conversation scenarios spanning multiple domains and topics of interest, quality control mechanisms, comprehensive transcription guidelines and transcription tools. We hope that this open source blueprint will serve as a comprehensive starter kit for data collection efforts in other multilingual regions of the world. Using INDICVOICES, we build IndicASR, the first ASR model to support all the 22 languages listed in the 8th schedule of the Constitution of India. All the data, tools, guidelines, models and other materials developed as a part of this work will be made publicly available |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_01926 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages Javed, Tahir Nawale, Janki Atul George, Eldho Ittan Joshi, Sakshi Bhogale, Kaushal Santosh Mehendale, Deovrat Sethi, Ishvinder Virender Ananthanarayanan, Aparna Faquih, Hafsah Palit, Pratiti Ravishankar, Sneha Sukumaran, Saranya Panchagnula, Tripura Murali, Sunjay Gandhi, Kunal Sharad R, Ambujavalli M, Manickam K Vaijayanthi, C Venkata Karunganni, Krishnan Srinivasa Raghavan Kumar, Pratyush Khapra, Mitesh M Computation and Language We present INDICVOICES, a dataset of natural and spontaneous speech containing a total of 7348 hours of read (9%), extempore (74%) and conversational (17%) audio from 16237 speakers covering 145 Indian districts and 22 languages. Of these 7348 hours, 1639 hours have already been transcribed, with a median of 73 hours per language. Through this paper, we share our journey of capturing the cultural, linguistic and demographic diversity of India to create a one-of-its-kind inclusive and representative dataset. More specifically, we share an open-source blueprint for data collection at scale comprising of standardised protocols, centralised tools, a repository of engaging questions, prompts and conversation scenarios spanning multiple domains and topics of interest, quality control mechanisms, comprehensive transcription guidelines and transcription tools. We hope that this open source blueprint will serve as a comprehensive starter kit for data collection efforts in other multilingual regions of the world. Using INDICVOICES, we build IndicASR, the first ASR model to support all the 22 languages listed in the 8th schedule of the Constitution of India. All the data, tools, guidelines, models and other materials developed as a part of this work will be made publicly available |
| title | IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2403.01926 |