Transformers and Language Models in Form Understanding: A Comprehensive Review of Scanned Document Analysis

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Abdallah, Abdelrahman, Eberharter, Daniel, Pfister, Zoe, Jatowt, Adam
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909130406494208
author Abdallah, Abdelrahman
Eberharter, Daniel
Pfister, Zoe
Jatowt, Adam
author_facet Abdallah, Abdelrahman
Eberharter, Daniel
Pfister, Zoe
Jatowt, Adam
contents This paper presents a comprehensive survey of research works on the topic of form understanding in the context of scanned documents. We delve into recent advancements and breakthroughs in the field, highlighting the significance of language models and transformers in solving this challenging task. Our research methodology involves an in-depth analysis of popular documents and forms of understanding of trends over the last decade, enabling us to offer valuable insights into the evolution of this domain. Focusing on cutting-edge models, we showcase how transformers have propelled the field forward, revolutionizing form-understanding techniques. Our exploration includes an extensive examination of state-of-the-art language models designed to effectively tackle the complexities of noisy scanned documents. Furthermore, we present an overview of the latest and most relevant datasets, which serve as essential benchmarks for evaluating the performance of selected models. By comparing and contrasting the capabilities of these models, we aim to provide researchers and practitioners with useful guidance in choosing the most suitable solutions for their specific form understanding tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2403_04080
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transformers and Language Models in Form Understanding: A Comprehensive Review of Scanned Document Analysis
Abdallah, Abdelrahman
Eberharter, Daniel
Pfister, Zoe
Jatowt, Adam
Computation and Language
Computer Vision and Pattern Recognition
This paper presents a comprehensive survey of research works on the topic of form understanding in the context of scanned documents. We delve into recent advancements and breakthroughs in the field, highlighting the significance of language models and transformers in solving this challenging task. Our research methodology involves an in-depth analysis of popular documents and forms of understanding of trends over the last decade, enabling us to offer valuable insights into the evolution of this domain. Focusing on cutting-edge models, we showcase how transformers have propelled the field forward, revolutionizing form-understanding techniques. Our exploration includes an extensive examination of state-of-the-art language models designed to effectively tackle the complexities of noisy scanned documents. Furthermore, we present an overview of the latest and most relevant datasets, which serve as essential benchmarks for evaluating the performance of selected models. By comparing and contrasting the capabilities of these models, we aim to provide researchers and practitioners with useful guidance in choosing the most suitable solutions for their specific form understanding tasks.
title Transformers and Language Models in Form Understanding: A Comprehensive Review of Scanned Document Analysis
topic Computation and Language
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.04080