Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Qintong, Wang, Bin, Huang, Victor Shea-Jay, Zhang, Junyuan, Wang, Zhengren, Liang, Hao, He, Conghui, Zhang, Wentao
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910101334392832
author Zhang, Qintong
Wang, Bin
Huang, Victor Shea-Jay
Zhang, Junyuan
Wang, Zhengren
Liang, Hao
He, Conghui
Zhang, Wentao
author_facet Zhang, Qintong
Wang, Bin
Huang, Victor Shea-Jay
Zhang, Junyuan
Wang, Zhengren
Liang, Hao
He, Conghui
Zhang, Wentao
contents Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG). This survey provides a comprehensive and timely review of document parsing research. We propose a systematic taxonomy that organizes existing approaches into modular pipeline-based systems and unified models driven by Vision-Language Models (VLMs). We provide a detailed review of key components in pipeline systems, including layout analysis and the recognition of heterogeneous content such as text, tables, mathematical expressions, and visual elements, and then systematically track the evolution of specialized VLMs for document parsing. Additionally, we summarize widely adopted evaluation metrics and high-quality benchmarks that establish current standards for parsing quality. Finally, we discuss key open challenges, including robustness to complex layouts, reliability of VLM-based parsing, and inference efficiency, and outline directions for building more accurate and scalable document intelligence systems.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21169
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
Zhang, Qintong
Wang, Bin
Huang, Victor Shea-Jay
Zhang, Junyuan
Wang, Zhengren
Liang, Hao
He, Conghui
Zhang, Wentao
Multimedia
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG). This survey provides a comprehensive and timely review of document parsing research. We propose a systematic taxonomy that organizes existing approaches into modular pipeline-based systems and unified models driven by Vision-Language Models (VLMs). We provide a detailed review of key components in pipeline systems, including layout analysis and the recognition of heterogeneous content such as text, tables, mathematical expressions, and visual elements, and then systematically track the evolution of specialized VLMs for document parsing. Additionally, we summarize widely adopted evaluation metrics and high-quality benchmarks that establish current standards for parsing quality. Finally, we discuss key open challenges, including robustness to complex layouts, reliability of VLM-based parsing, and inference efficiency, and outline directions for building more accurate and scalable document intelligence systems.
title Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction
topic Multimedia
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.21169