Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Maryam, Hiba, Fu, Ling, Song, Jiajun, Shafayet, Tajrian ABM, Luo, Qidi, Bai, Xiang, Liu, Yuliang
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929351143981056
author Maryam, Hiba
Fu, Ling
Song, Jiajun
Shafayet, Tajrian ABM
Luo, Qidi
Bai, Xiang
Liu, Yuliang
author_facet Maryam, Hiba
Fu, Ling
Song, Jiajun
Shafayet, Tajrian ABM
Luo, Qidi
Bai, Xiang
Liu, Yuliang
contents The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better understanding and interaction with Urdu-language visual data. This initiative seeks to bridge the gap between textual and visual comprehension. We propose a new multi-task Urdu scene text dataset comprising over 1000 natural scene images, which can be used for text detection, recognition, and VQA tasks. We provide fine-grained annotations for text instances, addressing the limitations of previous datasets for facing arbitrary-shaped texts. By incorporating additional annotation points, this dataset facilitates the development and assessment of methods that can handle diverse text layouts, intricate shapes, and non-standard orientations commonly encountered in real-world scenarios. Besides, the VQA annotations make it the first benchmark for the Urdu Text VQA method, which can prompt the development of Urdu scene text understanding. The proposed dataset is available at: https://github.com/Hiba-MeiRuan/Urdu-VQA-Dataset-/tree/main
format Preprint
id arxiv_https___arxiv_org_abs_2405_12533
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering
Maryam, Hiba
Fu, Ling
Song, Jiajun
Shafayet, Tajrian ABM
Luo, Qidi
Bai, Xiang
Liu, Yuliang
Computer Vision and Pattern Recognition
The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better understanding and interaction with Urdu-language visual data. This initiative seeks to bridge the gap between textual and visual comprehension. We propose a new multi-task Urdu scene text dataset comprising over 1000 natural scene images, which can be used for text detection, recognition, and VQA tasks. We provide fine-grained annotations for text instances, addressing the limitations of previous datasets for facing arbitrary-shaped texts. By incorporating additional annotation points, this dataset facilitates the development and assessment of methods that can handle diverse text layouts, intricate shapes, and non-standard orientations commonly encountered in real-world scenarios. Besides, the VQA annotations make it the first benchmark for the Urdu Text VQA method, which can prompt the development of Urdu scene text understanding. The proposed dataset is available at: https://github.com/Hiba-MeiRuan/Urdu-VQA-Dataset-/tree/main
title Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.12533