CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisions
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912180580909056 |
|---|---|
| author | Jourdan, Leane Boudin, Florian Hernandez, Nicolas Dufour, Richard |
| author_facet | Jourdan, Leane Boudin, Florian Hernandez, Nicolas Dufour, Richard |
| contents | Writing a scientific article is a challenging task as it is a highly codified and specific genre, consequently proficiency in written communication is essential for effectively conveying research findings and ideas. In this article, we propose an original textual resource on the revision step of the writing process of scientific articles. This new dataset, called CASIMIR, contains the multiple revised versions of 15,646 scientific articles from OpenReview, along with their peer reviews. Pairs of consecutive versions of an article are aligned at sentence-level while keeping paragraph location information as metadata for supporting future revision studies at the discourse level. Each pair of revised sentences is enriched with automatically extracted edits and associated revision intention. To assess the initial quality on the dataset, we conducted a qualitative study of several state-of-the-art text revision approaches and compared various evaluation metrics. Our experiments led us to question the relevance of the current evaluation methods for the text revision task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_00241 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisions Jourdan, Leane Boudin, Florian Hernandez, Nicolas Dufour, Richard Computation and Language Writing a scientific article is a challenging task as it is a highly codified and specific genre, consequently proficiency in written communication is essential for effectively conveying research findings and ideas. In this article, we propose an original textual resource on the revision step of the writing process of scientific articles. This new dataset, called CASIMIR, contains the multiple revised versions of 15,646 scientific articles from OpenReview, along with their peer reviews. Pairs of consecutive versions of an article are aligned at sentence-level while keeping paragraph location information as metadata for supporting future revision studies at the discourse level. Each pair of revised sentences is enriched with automatically extracted edits and associated revision intention. To assess the initial quality on the dataset, we conducted a qualitative study of several state-of-the-art text revision approaches and compared various evaluation metrics. Our experiments led us to question the relevance of the current evaluation methods for the text revision task. |
| title | CASIMIR: A Corpus of Scientific Articles enhanced with Multiple Author-Integrated Revisions |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2403.00241 |