Contextualizing Generated Citation Texts

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mandal, Biswadip, Li, Xiangci, Ouyang, Jessica
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929258446716928
author Mandal, Biswadip
Li, Xiangci
Ouyang, Jessica
author_facet Mandal, Biswadip
Li, Xiangci
Ouyang, Jessica
contents Abstractive citation text generation is usually framed as an infilling task, where a sequence-to-sequence model is trained to generate a citation given a reference paper and the context window around the target; the generated citation should be a brief discussion of the reference paper as it relates to the citing context. However, examining a recent LED-based citation generation system, we find that many of the generated citations are generic summaries of the reference papers main contribution, ignoring the citation contexts focus on a different topic. To address this problem, we propose a simple modification to the citation text generation task: the generation target is not only the citation itself, but the entire context window, including the target citation. This approach can be easily applied to any abstractive citation generation system, and our experimental results show that training in this way is preferred by human readers and allows the generation model to make use of contextual clues about what topic to discuss and what stance to take.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18054
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Contextualizing Generated Citation Texts
Mandal, Biswadip
Li, Xiangci
Ouyang, Jessica
Computation and Language
Abstractive citation text generation is usually framed as an infilling task, where a sequence-to-sequence model is trained to generate a citation given a reference paper and the context window around the target; the generated citation should be a brief discussion of the reference paper as it relates to the citing context. However, examining a recent LED-based citation generation system, we find that many of the generated citations are generic summaries of the reference papers main contribution, ignoring the citation contexts focus on a different topic. To address this problem, we propose a simple modification to the citation text generation task: the generation target is not only the citation itself, but the entire context window, including the target citation. This approach can be easily applied to any abstractive citation generation system, and our experimental results show that training in this way is preferred by human readers and allows the generation model to make use of contextual clues about what topic to discuss and what stance to take.
title Contextualizing Generated Citation Texts
topic Computation and Language
url https://arxiv.org/abs/2402.18054