Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2404.10848 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911842277785600 |
|---|---|
| author | Adnan, Wiam Tang, Joel Zouggari, Yassine Bel Khayat Laatiri, Seif Edinne Lam, Laurent Caspani, Fabien |
| author_facet | Adnan, Wiam Tang, Joel Zouggari, Yassine Bel Khayat Laatiri, Seif Edinne Lam, Laurent Caspani, Fabien |
| contents | Document Understanding is an evolving field in Natural Language Processing (NLP). In particular, visual and spatial features are essential in addition to the raw text itself and hence, several multimodal models were developed in the field of Visual Document Understanding (VDU). However, while research is mainly focused on Key Information Extraction (KIE), Relation Extraction (RE) between identified entities is still under-studied. For instance, RE is crucial to regroup entities or obtain a comprehensive hierarchy of data in a document. In this paper, we present a model that, initialized from LayoutLMv3, can match or outperform the current state-of-the-art results in RE applied to Visually-Rich Documents (VRD) on FUNSD and CORD datasets, without any specific pre-training and with fewer parameters. We also report an extensive ablation study performed on FUNSD, highlighting the great impact of certain features and modelization choices on the performances. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_10848 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A LayoutLMv3-Based Model for Enhanced Relation Extraction in Visually-Rich Documents Adnan, Wiam Tang, Joel Zouggari, Yassine Bel Khayat Laatiri, Seif Edinne Lam, Laurent Caspani, Fabien Computation and Language Artificial Intelligence Machine Learning Document Understanding is an evolving field in Natural Language Processing (NLP). In particular, visual and spatial features are essential in addition to the raw text itself and hence, several multimodal models were developed in the field of Visual Document Understanding (VDU). However, while research is mainly focused on Key Information Extraction (KIE), Relation Extraction (RE) between identified entities is still under-studied. For instance, RE is crucial to regroup entities or obtain a comprehensive hierarchy of data in a document. In this paper, we present a model that, initialized from LayoutLMv3, can match or outperform the current state-of-the-art results in RE applied to Visually-Rich Documents (VRD) on FUNSD and CORD datasets, without any specific pre-training and with fewer parameters. We also report an extensive ablation study performed on FUNSD, highlighting the great impact of certain features and modelization choices on the performances. |
| title | A LayoutLMv3-Based Model for Enhanced Relation Extraction in Visually-Rich Documents |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2404.10848 |