ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jourdan, Léane, Hernandez, Nicolas, Dufour, Richard, Boudin, Florian, Aizawa, Akiko
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913669488574464
author Jourdan, Léane
Hernandez, Nicolas
Dufour, Richard
Boudin, Florian
Aizawa, Akiko
author_facet Jourdan, Léane
Hernandez, Nicolas
Dufour, Richard
Boudin, Florian
Aizawa, Akiko
contents Revision is a crucial step in scientific writing, where authors refine their work to improve clarity, structure, and academic quality. Existing approaches to automated writing assistance often focus on sentence-level revisions, which fail to capture the broader context needed for effective modification. In this paper, we explore the impact of shifting from sentence-level to paragraph-level scope for the task of scientific text revision. The paragraph level definition of the task allows for more meaningful changes, and is guided by detailed revision instructions rather than general ones. To support this task, we introduce ParaRev, the first dataset of revised scientific paragraphs with an evaluation subset manually annotated with revision instructions. Our experiments demonstrate that using detailed instructions significantly improves the quality of automated revisions compared to general approaches, no matter the model or the metric considered.
format Preprint
id arxiv_https___arxiv_org_abs_2501_05222
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction
Jourdan, Léane
Hernandez, Nicolas
Dufour, Richard
Boudin, Florian
Aizawa, Akiko
Computation and Language
Revision is a crucial step in scientific writing, where authors refine their work to improve clarity, structure, and academic quality. Existing approaches to automated writing assistance often focus on sentence-level revisions, which fail to capture the broader context needed for effective modification. In this paper, we explore the impact of shifting from sentence-level to paragraph-level scope for the task of scientific text revision. The paragraph level definition of the task allows for more meaningful changes, and is guided by detailed revision instructions rather than general ones. To support this task, we introduce ParaRev, the first dataset of revised scientific paragraphs with an evaluation subset manually annotated with revision instructions. Our experiments demonstrate that using detailed instructions significantly improves the quality of automated revisions compared to general approaches, no matter the model or the metric considered.
title ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction
topic Computation and Language
url https://arxiv.org/abs/2501.05222