Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Das, Alloy, Biswas, Sanket, Pal, Umapada, Lladós, Josep
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929246270652416
author Das, Alloy
Biswas, Sanket
Pal, Umapada
Lladós, Josep
author_facet Das, Alloy
Biswas, Sanket
Pal, Umapada
Lladós, Josep
contents When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2310_00558
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes
Das, Alloy
Biswas, Sanket
Pal, Umapada
Lladós, Josep
Computer Vision and Pattern Recognition
When used in a real-world noisy environment, the capacity to generalize to multiple domains is essential for any autonomous scene text spotting system. However, existing state-of-the-art methods employ pretraining and fine-tuning strategies on natural scene datasets, which do not exploit the feature interaction across other complex domains. In this work, we explore and investigate the problem of domain-agnostic scene text spotting, i.e., training a model on multi-domain source data such that it can directly generalize to target domains rather than being specialized for a specific domain or scenario. In this regard, we present the community a text spotting validation benchmark called Under-Water Text (UWT) for noisy underwater scenes to establish an important case study. Moreover, we also design an efficient super-resolution based end-to-end transformer baseline called DA-TextSpotter which achieves comparable or superior performance over existing text spotting architectures for both regular and arbitrary-shaped scene text spotting benchmarks in terms of both accuracy and model efficiency. The dataset, code and pre-trained models will be released upon acceptance.
title Diving into the Depths of Spotting Text in Multi-Domain Noisy Scenes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2310.00558