Open-Source Conversational AI with SpeechBrain 1.0
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910690296463360 |
|---|---|
| author | Ravanelli, Mirco Parcollet, Titouan Moumen, Adel de Langen, Sylvain Subakan, Cem Plantinga, Peter Wang, Yingzhi Mousavi, Pooneh Della Libera, Luca Ploujnikov, Artem Paissan, Francesco Borra, Davide Zaiem, Salah Zhao, Zeyu Zhang, Shucong Karakasidis, Georgios Yeh, Sung-Lin Champion, Pierre Rouhe, Aku Braun, Rudolf Mai, Florian Zuluaga-Gomez, Juan Mousavi, Seyed Mahed Nautsch, Andreas Nguyen, Ha Liu, Xuechen Sagar, Sangeet Duret, Jarod Mdhaffar, Salima Laperriere, Gaelle Rouvier, Mickael De Mori, Renato Esteve, Yannick |
| author_facet | Ravanelli, Mirco Parcollet, Titouan Moumen, Adel de Langen, Sylvain Subakan, Cem Plantinga, Peter Wang, Yingzhi Mousavi, Pooneh Della Libera, Luca Ploujnikov, Artem Paissan, Francesco Borra, Davide Zaiem, Salah Zhao, Zeyu Zhang, Shucong Karakasidis, Georgios Yeh, Sung-Lin Champion, Pierre Rouhe, Aku Braun, Rudolf Mai, Florian Zuluaga-Gomez, Juan Mousavi, Seyed Mahed Nautsch, Andreas Nguyen, Ha Liu, Xuechen Sagar, Sangeet Duret, Jarod Mdhaffar, Salima Laperriere, Gaelle Rouvier, Mickael De Mori, Renato Esteve, Yannick |
| contents | SpeechBrain is an open-source Conversational AI toolkit based on PyTorch, focused particularly on speech processing tasks such as speech recognition, speech enhancement, speaker recognition, text-to-speech, and much more. It promotes transparency and replicability by releasing both the pre-trained models and the complete "recipes" of code and algorithms required for training them. This paper presents SpeechBrain 1.0, a significant milestone in the evolution of the toolkit, which now has over 200 recipes for speech, audio, and language processing tasks, and more than 100 models available on Hugging Face. SpeechBrain 1.0 introduces new technologies to support diverse learning modalities, Large Language Model (LLM) integration, and advanced decoding strategies, along with novel models, tasks, and modalities. It also includes a new benchmark repository, offering researchers a unified platform for evaluating models across diverse tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_00463 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Open-Source Conversational AI with SpeechBrain 1.0 Ravanelli, Mirco Parcollet, Titouan Moumen, Adel de Langen, Sylvain Subakan, Cem Plantinga, Peter Wang, Yingzhi Mousavi, Pooneh Della Libera, Luca Ploujnikov, Artem Paissan, Francesco Borra, Davide Zaiem, Salah Zhao, Zeyu Zhang, Shucong Karakasidis, Georgios Yeh, Sung-Lin Champion, Pierre Rouhe, Aku Braun, Rudolf Mai, Florian Zuluaga-Gomez, Juan Mousavi, Seyed Mahed Nautsch, Andreas Nguyen, Ha Liu, Xuechen Sagar, Sangeet Duret, Jarod Mdhaffar, Salima Laperriere, Gaelle Rouvier, Mickael De Mori, Renato Esteve, Yannick Machine Learning Artificial Intelligence Computation and Language Human-Computer Interaction Audio and Speech Processing SpeechBrain is an open-source Conversational AI toolkit based on PyTorch, focused particularly on speech processing tasks such as speech recognition, speech enhancement, speaker recognition, text-to-speech, and much more. It promotes transparency and replicability by releasing both the pre-trained models and the complete "recipes" of code and algorithms required for training them. This paper presents SpeechBrain 1.0, a significant milestone in the evolution of the toolkit, which now has over 200 recipes for speech, audio, and language processing tasks, and more than 100 models available on Hugging Face. SpeechBrain 1.0 introduces new technologies to support diverse learning modalities, Large Language Model (LLM) integration, and advanced decoding strategies, along with novel models, tasks, and modalities. It also includes a new benchmark repository, offering researchers a unified platform for evaluating models across diverse tasks. |
| title | Open-Source Conversational AI with SpeechBrain 1.0 |
| topic | Machine Learning Artificial Intelligence Computation and Language Human-Computer Interaction Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.00463 |