SynthDoc: Bilingual Documents Synthesis for Visual Document Understanding
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910578277089280 |
|---|---|
| author | Ding, Chuanghao Liu, Xuejing Tang, Wei Li, Juan Wang, Xiaoliang Zhao, Rui Nguyen, Cam-Tu Tan, Fei |
| author_facet | Ding, Chuanghao Liu, Xuejing Tang, Wei Li, Juan Wang, Xiaoliang Zhao, Rui Nguyen, Cam-Tu Tan, Fei |
| contents | This paper introduces SynthDoc, a novel synthetic document generation pipeline designed to enhance Visual Document Understanding (VDU) by generating high-quality, diverse datasets that include text, images, tables, and charts. Addressing the challenges of data acquisition and the limitations of existing datasets, SynthDoc leverages publicly available corpora and advanced rendering tools to create a comprehensive and versatile dataset. Our experiments, conducted using the Donut model, demonstrate that models trained with SynthDoc's data achieve superior performance in pre-training read tasks and maintain robustness in downstream tasks, despite language inconsistencies. The release of a benchmark dataset comprising 5,000 image-text pairs not only showcases the pipeline's capabilities but also provides a valuable resource for the VDU community to advance research and development in document image recognition. This work significantly contributes to the field by offering a scalable solution to data scarcity and by validating the efficacy of end-to-end models in parsing complex, real-world documents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_14764 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SynthDoc: Bilingual Documents Synthesis for Visual Document Understanding Ding, Chuanghao Liu, Xuejing Tang, Wei Li, Juan Wang, Xiaoliang Zhao, Rui Nguyen, Cam-Tu Tan, Fei Computer Vision and Pattern Recognition Multimedia This paper introduces SynthDoc, a novel synthetic document generation pipeline designed to enhance Visual Document Understanding (VDU) by generating high-quality, diverse datasets that include text, images, tables, and charts. Addressing the challenges of data acquisition and the limitations of existing datasets, SynthDoc leverages publicly available corpora and advanced rendering tools to create a comprehensive and versatile dataset. Our experiments, conducted using the Donut model, demonstrate that models trained with SynthDoc's data achieve superior performance in pre-training read tasks and maintain robustness in downstream tasks, despite language inconsistencies. The release of a benchmark dataset comprising 5,000 image-text pairs not only showcases the pipeline's capabilities but also provides a valuable resource for the VDU community to advance research and development in document image recognition. This work significantly contributes to the field by offering a scalable solution to data scarcity and by validating the efficacy of end-to-end models in parsing complex, real-world documents. |
| title | SynthDoc: Bilingual Documents Synthesis for Visual Document Understanding |
| topic | Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/2408.14764 |