A Vietnamese Dataset for Text Segmentation and Multiple Choices Reading Comprehension
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913901197656064 |
|---|---|
| author | Hai, Toan Nguyen Viet, Ha Nguyen Xuan, Truong Quan Minh, Duc Do |
| author_facet | Hai, Toan Nguyen Viet, Ha Nguyen Xuan, Truong Quan Minh, Duc Do |
| contents | Vietnamese, the 20th most spoken language with over 102 million native speakers, lacks robust resources for key natural language processing tasks such as text segmentation and machine reading comprehension (MRC). To address this gap, we present VSMRC, the Vietnamese Text Segmentation and Multiple-Choice Reading Comprehension Dataset. Sourced from Vietnamese Wikipedia, our dataset includes 15,942 documents for text segmentation and 16,347 synthetic multiple-choice question-answer pairs generated with human quality assurance, ensuring a reliable and diverse resource. Experiments show that mBERT consistently outperforms monolingual models on both tasks, achieving an accuracy of 88.01% on MRC test set and an F1 score of 63.15\% on text segmentation test set. Our analysis reveals that multilingual models excel in NLP tasks for Vietnamese, suggesting potential applications to other under-resourced languages. VSMRC is available at HuggingFace |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_15978 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Vietnamese Dataset for Text Segmentation and Multiple Choices Reading Comprehension Hai, Toan Nguyen Viet, Ha Nguyen Xuan, Truong Quan Minh, Duc Do Computation and Language Artificial Intelligence Vietnamese, the 20th most spoken language with over 102 million native speakers, lacks robust resources for key natural language processing tasks such as text segmentation and machine reading comprehension (MRC). To address this gap, we present VSMRC, the Vietnamese Text Segmentation and Multiple-Choice Reading Comprehension Dataset. Sourced from Vietnamese Wikipedia, our dataset includes 15,942 documents for text segmentation and 16,347 synthetic multiple-choice question-answer pairs generated with human quality assurance, ensuring a reliable and diverse resource. Experiments show that mBERT consistently outperforms monolingual models on both tasks, achieving an accuracy of 88.01% on MRC test set and an F1 score of 63.15\% on text segmentation test set. Our analysis reveals that multilingual models excel in NLP tasks for Vietnamese, suggesting potential applications to other under-resourced languages. VSMRC is available at HuggingFace |
| title | A Vietnamese Dataset for Text Segmentation and Multiple Choices Reading Comprehension |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2506.15978 |