Saved in:
Bibliographic Details
Main Authors: Singhania, Sneha, Razniewski, Simon, Weikum, Gerhard
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.02732
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913744008773632
author Singhania, Sneha
Razniewski, Simon
Weikum, Gerhard
author_facet Singhania, Sneha
Razniewski, Simon
Weikum, Gerhard
contents Methods for relation extraction from text mostly focus on high precision, at the cost of limited recall. High recall is crucial, though, to populate long lists of object entities that stand in a specific relation with a given subject. Cues for relevant objects can be spread across many passages in long texts. This poses the challenge of extracting long lists from long texts. We present the L3X method which tackles the problem in two stages: (1) recall-oriented generation using a large language model (LLM) with judicious techniques for retrieval augmentation, and (2) precision-oriented scrutinization to validate or prune candidates. Our L3X method outperforms LLM-only generations by a substantial margin.
format Preprint
id arxiv_https___arxiv_org_abs_2405_02732
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Recall Them All: Retrieval-Augmented Language Models for Long Object List Extraction from Long Documents
Singhania, Sneha
Razniewski, Simon
Weikum, Gerhard
Computation and Language
Information Retrieval
Methods for relation extraction from text mostly focus on high precision, at the cost of limited recall. High recall is crucial, though, to populate long lists of object entities that stand in a specific relation with a given subject. Cues for relevant objects can be spread across many passages in long texts. This poses the challenge of extracting long lists from long texts. We present the L3X method which tackles the problem in two stages: (1) recall-oriented generation using a large language model (LLM) with judicious techniques for retrieval augmentation, and (2) precision-oriented scrutinization to validate or prune candidates. Our L3X method outperforms LLM-only generations by a substantial margin.
title Recall Them All: Retrieval-Augmented Language Models for Long Object List Extraction from Long Documents
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2405.02732