Intelligibility of Text-to-Speech Systems for Mathematical Expressions
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911002968195072 |
|---|---|
| author | Roychowdhury, Sujoy Ranjani, H. G. Soman, Sumit Paul, Nishtha Bandyopadhyay, Subhadip Iyengar, Siddhanth |
| author_facet | Roychowdhury, Sujoy Ranjani, H. G. Soman, Sumit Paul, Nishtha Bandyopadhyay, Subhadip Iyengar, Siddhanth |
| contents | There has been limited evaluation of advanced Text-to-Speech (TTS) models with Mathematical eXpressions (MX) as inputs. In this work, we design experiments to evaluate quality and intelligibility of five TTS models through listening and transcribing tests for various categories of MX. We use two Large Language Models (LLMs) to generate English pronunciation from LaTeX MX as TTS models cannot process LaTeX directly. We use Mean Opinion Score from user ratings and quantify intelligibility through transcription correctness using three metrics. We also compare listener preference of TTS outputs with respect to human expert rendition of same MX. Results establish that output of TTS models for MX is not necessarily intelligible, the gap in intelligibility varies across TTS models and MX category. For most categories, performance of TTS models is significantly worse than that of expert rendition. The effect of choice of LLM is limited. This establishes the need to improve TTS models for MX. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_11086 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Intelligibility of Text-to-Speech Systems for Mathematical Expressions Roychowdhury, Sujoy Ranjani, H. G. Soman, Sumit Paul, Nishtha Bandyopadhyay, Subhadip Iyengar, Siddhanth Audio and Speech Processing Artificial Intelligence There has been limited evaluation of advanced Text-to-Speech (TTS) models with Mathematical eXpressions (MX) as inputs. In this work, we design experiments to evaluate quality and intelligibility of five TTS models through listening and transcribing tests for various categories of MX. We use two Large Language Models (LLMs) to generate English pronunciation from LaTeX MX as TTS models cannot process LaTeX directly. We use Mean Opinion Score from user ratings and quantify intelligibility through transcription correctness using three metrics. We also compare listener preference of TTS outputs with respect to human expert rendition of same MX. Results establish that output of TTS models for MX is not necessarily intelligible, the gap in intelligibility varies across TTS models and MX category. For most categories, performance of TTS models is significantly worse than that of expert rendition. The effect of choice of LLM is limited. This establishes the need to improve TTS models for MX. |
| title | Intelligibility of Text-to-Speech Systems for Mathematical Expressions |
| topic | Audio and Speech Processing Artificial Intelligence |
| url | https://arxiv.org/abs/2506.11086 |