OCRTurk: A Comprehensive OCR Benchmark for Turkish
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915771639136256 |
|---|---|
| author | Yılmaz, Deniz Munis, Evren Ayberk Toraman, Çağrı Köse, Süha Kağan Aktaş, Burak Baytekin, Mehmet Can Görür, Bilge Kaan |
| author_facet | Yılmaz, Deniz Munis, Evren Ayberk Toraman, Çağrı Köse, Süha Kağan Aktaş, Burak Baytekin, Mehmet Can Görür, Bilge Kaan |
| contents | Document parsing is now widely used in applications, such as large-scale document digitization, retrieval-augmented generation, and domain-specific pipelines in healthcare and education. Benchmarking these models is crucial for assessing their reliability and practical robustness. Existing benchmarks mostly target high-resource languages and provide limited coverage for low-resource settings, such as Turkish. Moreover, existing studies on Turkish document parsing lack a standardized benchmark that reflects real-world scenarios and document diversity. To address this gap, we introduce OCRTurk, a Turkish document parsing benchmark covering multiple layout elements and document categories at three difficulty levels. OCRTurk consists of 180 Turkish documents drawn from academic articles, theses, slide decks, and non-academic articles. We evaluate seven OCR models on OCRTurk using element-wise metrics. Across difficulty levels, PaddleOCR achieves the strongest overall results, leading most element-wise metrics except figures and attaining high Normalized Edit Distance scores in easy, medium, and hard subsets. We also observe performance variation by document type. Models perform well on non-academic documents, while slideshows become the most challenging. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_03693 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | OCRTurk: A Comprehensive OCR Benchmark for Turkish Yılmaz, Deniz Munis, Evren Ayberk Toraman, Çağrı Köse, Süha Kağan Aktaş, Burak Baytekin, Mehmet Can Görür, Bilge Kaan Computation and Language Artificial Intelligence Document parsing is now widely used in applications, such as large-scale document digitization, retrieval-augmented generation, and domain-specific pipelines in healthcare and education. Benchmarking these models is crucial for assessing their reliability and practical robustness. Existing benchmarks mostly target high-resource languages and provide limited coverage for low-resource settings, such as Turkish. Moreover, existing studies on Turkish document parsing lack a standardized benchmark that reflects real-world scenarios and document diversity. To address this gap, we introduce OCRTurk, a Turkish document parsing benchmark covering multiple layout elements and document categories at three difficulty levels. OCRTurk consists of 180 Turkish documents drawn from academic articles, theses, slide decks, and non-academic articles. We evaluate seven OCR models on OCRTurk using element-wise metrics. Across difficulty levels, PaddleOCR achieves the strongest overall results, leading most element-wise metrics except figures and attaining high Normalized Edit Distance scores in easy, medium, and hard subsets. We also observe performance variation by document type. Models perform well on non-academic documents, while slideshows become the most challenging. |
| title | OCRTurk: A Comprehensive OCR Benchmark for Turkish |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2602.03693 |