Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lior, Gili, Goldberg, Yoav, Stanovsky, Gabriel
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909752437506048
author Lior, Gili
Goldberg, Yoav
Stanovsky, Gabriel
author_facet Lior, Gili
Goldberg, Yoav
Stanovsky, Gabriel
contents Document collections of various domains, e.g., legal, medical, or financial, often share some underlying collection-wide structure, which captures information that can aid both human users and structure-aware models. We propose to identify the typical structure of document within a collection, which requires to capture recurring topics across the collection, while abstracting over arbitrary header paraphrases, and ground each topic to respective document locations. These requirements pose several challenges: headers that mark recurring topics frequently differ in phrasing, certain section headers are unique to individual documents and do not reflect the typical structure, and the order of topics can vary between documents. Subsequently, we develop an unsupervised graph-based method which leverages both inter- and intra-document similarities, to extract the underlying collection-wide structure. Our evaluations on three diverse domains in both English and Hebrew indicate that our method extracts meaningful collection-wide structure, and we hope that future work will leverage our method for multi-document applications and structure-aware models.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13906
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction
Lior, Gili
Goldberg, Yoav
Stanovsky, Gabriel
Computation and Language
Document collections of various domains, e.g., legal, medical, or financial, often share some underlying collection-wide structure, which captures information that can aid both human users and structure-aware models. We propose to identify the typical structure of document within a collection, which requires to capture recurring topics across the collection, while abstracting over arbitrary header paraphrases, and ground each topic to respective document locations. These requirements pose several challenges: headers that mark recurring topics frequently differ in phrasing, certain section headers are unique to individual documents and do not reflect the typical structure, and the order of topics can vary between documents. Subsequently, we develop an unsupervised graph-based method which leverages both inter- and intra-document similarities, to extract the underlying collection-wide structure. Our evaluations on three diverse domains in both English and Hebrew indicate that our method extracts meaningful collection-wide structure, and we hope that future work will leverage our method for multi-document applications and structure-aware models.
title Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction
topic Computation and Language
url https://arxiv.org/abs/2402.13906