Saved in:
Bibliographic Details
Main Authors: Lopez-Duran, Miguel, Fierrez, Julian, Morales, Aythami, Tolosana, Ruben, Delgado-Mohatar, Oscar, Ortigosa, Alvaro
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.14699
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915412408532992
author Lopez-Duran, Miguel
Fierrez, Julian
Morales, Aythami
Tolosana, Ruben
Delgado-Mohatar, Oscar
Ortigosa, Alvaro
author_facet Lopez-Duran, Miguel
Fierrez, Julian
Morales, Aythami
Tolosana, Ruben
Delgado-Mohatar, Oscar
Ortigosa, Alvaro
contents The automatic analysis of document layouts in digital-born PDF documents remains a challenging problem due to the heterogeneous arrangement of textual and nontextual elements and the imprecision of the textual metadata in the Portable Document Format. In this work, we benchmark Graph Neural Network (GNN) architectures for the task of fine-grained layout classification of text blocks from digital native documents. We introduce two graph construction structures: a k-closest-neighbor graph and a fully connected graph, and generate node features via pre-trained text and vision models, thus avoiding manual feature engineering. Three experimental frameworks are evaluated: single-modality (text or visual), concatenated multimodal, and dual-branch multimodal. We evaluated four foundational GNN models and compared them with the baseline. Our experiments are specifically conducted on a rich dataset of public affairs documents that includes more than 20 sources (e.g., regional and national-level official gazettes), 37K PDF documents, with 441K pages in total. Our results demonstrate that GraphSAGE operating on the k-closest-neighbor graph in a dual-branch configuration achieves the highest per-class and overall accuracy, outperforming the baseline in some sources. These findings confirm the importance of local layout relationships and multimodal fusion exploited through GNNs for the analysis of native digital document layouts.
format Preprint
id arxiv_https___arxiv_org_abs_2505_14699
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairs
Lopez-Duran, Miguel
Fierrez, Julian
Morales, Aythami
Tolosana, Ruben
Delgado-Mohatar, Oscar
Ortigosa, Alvaro
Computer Vision and Pattern Recognition
Computation and Language
Machine Learning
The automatic analysis of document layouts in digital-born PDF documents remains a challenging problem due to the heterogeneous arrangement of textual and nontextual elements and the imprecision of the textual metadata in the Portable Document Format. In this work, we benchmark Graph Neural Network (GNN) architectures for the task of fine-grained layout classification of text blocks from digital native documents. We introduce two graph construction structures: a k-closest-neighbor graph and a fully connected graph, and generate node features via pre-trained text and vision models, thus avoiding manual feature engineering. Three experimental frameworks are evaluated: single-modality (text or visual), concatenated multimodal, and dual-branch multimodal. We evaluated four foundational GNN models and compared them with the baseline. Our experiments are specifically conducted on a rich dataset of public affairs documents that includes more than 20 sources (e.g., regional and national-level official gazettes), 37K PDF documents, with 441K pages in total. Our results demonstrate that GraphSAGE operating on the k-closest-neighbor graph in a dual-branch configuration achieves the highest per-class and overall accuracy, outperforming the baseline in some sources. These findings confirm the importance of local layout relationships and multimodal fusion exploited through GNNs for the analysis of native digital document layouts.
title Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairs
topic Computer Vision and Pattern Recognition
Computation and Language
Machine Learning
url https://arxiv.org/abs/2505.14699