Self-Supervised Learning for Text Recognition: A Critical Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Penarrubia, Carlos, Valero-Mas, Jose J., Calvo-Zaragoza, Jorge
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913875802193920
author Penarrubia, Carlos
Valero-Mas, Jose J.
Calvo-Zaragoza, Jorge
author_facet Penarrubia, Carlos
Valero-Mas, Jose J.
Calvo-Zaragoza, Jorge
contents Text Recognition (TR) refers to the research area that focuses on retrieving textual information from images, a topic that has seen significant advancements in the last decade due to the use of Deep Neural Networks (DNN). However, these solutions often necessitate vast amounts of manually labeled or synthetic data. Addressing this challenge, Self-Supervised Learning (SSL) has gained attention by utilizing large datasets of unlabeled data to train DNN, thereby generating meaningful and robust representations. Although SSL was initially overlooked in TR because of its unique characteristics, recent years have witnessed a surge in the development of SSL methods specifically for this field. This rapid development, however, has led to many methods being explored independently, without taking previous efforts in methodology or comparison into account, thereby hindering progress in the field of research. This paper, therefore, seeks to consolidate the use of SSL in the field of TR, offering a critical and comprehensive overview of the current state of the art. We will review and analyze the existing methods, compare their results, and highlight inconsistencies in the current literature. This thorough analysis aims to provide general insights into the field, propose standardizations, identify new research directions, and foster its proper development.
format Preprint
id arxiv_https___arxiv_org_abs_2407_19889
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-Supervised Learning for Text Recognition: A Critical Survey
Penarrubia, Carlos
Valero-Mas, Jose J.
Calvo-Zaragoza, Jorge
Computer Vision and Pattern Recognition
Text Recognition (TR) refers to the research area that focuses on retrieving textual information from images, a topic that has seen significant advancements in the last decade due to the use of Deep Neural Networks (DNN). However, these solutions often necessitate vast amounts of manually labeled or synthetic data. Addressing this challenge, Self-Supervised Learning (SSL) has gained attention by utilizing large datasets of unlabeled data to train DNN, thereby generating meaningful and robust representations. Although SSL was initially overlooked in TR because of its unique characteristics, recent years have witnessed a surge in the development of SSL methods specifically for this field. This rapid development, however, has led to many methods being explored independently, without taking previous efforts in methodology or comparison into account, thereby hindering progress in the field of research. This paper, therefore, seeks to consolidate the use of SSL in the field of TR, offering a critical and comprehensive overview of the current state of the art. We will review and analyze the existing methods, compare their results, and highlight inconsistencies in the current literature. This thorough analysis aims to provide general insights into the field, propose standardizations, identify new research directions, and foster its proper development.
title Self-Supervised Learning for Text Recognition: A Critical Survey
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.19889