Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.07502 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918050647769088 |
|---|---|
| author | Guo, Haotian Han, Jing Tu, Yongfeng Gao, Shihao Shen, Shengfan Xiang, Wulong Gan, Weihao Zhang, Zixing |
| author_facet | Guo, Haotian Han, Jing Tu, Yongfeng Gao, Shihao Shen, Shengfan Xiang, Wulong Gan, Weihao Zhang, Zixing |
| contents | Despite extensive research on textual and visual disambiguation, disambiguation through speech (DTS) remains underexplored. This is largely due to the lack of high-quality datasets that pair spoken sentences with richly ambiguous text. To address this gap, we present DEBATE, a unique public Chinese speech-text dataset designed to study how speech cues and patterns-pronunciation, pause, stress and intonation-can help resolve textual ambiguity and reveal a speaker's true intent. DEBATE contains 1,001 carefully selected ambiguous utterances, each recorded by 10 native speakers, capturing diverse linguistic ambiguities and their disambiguation through speech. We detail the data collection pipeline and provide rigorous quality analysis. Additionally, we benchmark three state-of-the-art large speech and audio-language models, illustrating clear and huge performance gaps between machine and human understanding of spoken intent. DEBATE represents the first effort of its kind and offers a foundation for building similar DTS datasets across languages and cultures. The dataset and associated code are available at: https://github.com/SmileHnu/DEBATE. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_07502 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DEBATE: A Dataset for Disentangling Textual Ambiguity in Mandarin Through Speech Guo, Haotian Han, Jing Tu, Yongfeng Gao, Shihao Shen, Shengfan Xiang, Wulong Gan, Weihao Zhang, Zixing Computation and Language Despite extensive research on textual and visual disambiguation, disambiguation through speech (DTS) remains underexplored. This is largely due to the lack of high-quality datasets that pair spoken sentences with richly ambiguous text. To address this gap, we present DEBATE, a unique public Chinese speech-text dataset designed to study how speech cues and patterns-pronunciation, pause, stress and intonation-can help resolve textual ambiguity and reveal a speaker's true intent. DEBATE contains 1,001 carefully selected ambiguous utterances, each recorded by 10 native speakers, capturing diverse linguistic ambiguities and their disambiguation through speech. We detail the data collection pipeline and provide rigorous quality analysis. Additionally, we benchmark three state-of-the-art large speech and audio-language models, illustrating clear and huge performance gaps between machine and human understanding of spoken intent. DEBATE represents the first effort of its kind and offers a foundation for building similar DTS datasets across languages and cultures. The dataset and associated code are available at: https://github.com/SmileHnu/DEBATE. |
| title | DEBATE: A Dataset for Disentangling Textual Ambiguity in Mandarin Through Speech |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.07502 |