Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ranathunga, Surangika, de Silva, Nisansa, Jayakody, Dilith, Fernando, Aloka
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911911746994176
author Ranathunga, Surangika
de Silva, Nisansa
Jayakody, Dilith
Fernando, Aloka
author_facet Ranathunga, Surangika
de Silva, Nisansa
Jayakody, Dilith
Fernando, Aloka
contents We analysed a sample of NLP research papers archived in ACL Anthology as an attempt to quantify the degree of openness and the benefit of such an open culture in the NLP community. We observe that papers published in different NLP venues show different patterns related to artefact reuse. We also note that more than 30% of the papers we analysed do not release their artefacts publicly, despite promising to do so. Further, we observe a wide language-wise disparity in publicly available NLP-related artefacts.
format Preprint
id arxiv_https___arxiv_org_abs_2406_06021
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research
Ranathunga, Surangika
de Silva, Nisansa
Jayakody, Dilith
Fernando, Aloka
Computation and Language
We analysed a sample of NLP research papers archived in ACL Anthology as an attempt to quantify the degree of openness and the benefit of such an open culture in the NLP community. We observe that papers published in different NLP venues show different patterns related to artefact reuse. We also note that more than 30% of the papers we analysed do not release their artefacts publicly, despite promising to do so. Further, we observe a wide language-wise disparity in publicly available NLP-related artefacts.
title Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research
topic Computation and Language
url https://arxiv.org/abs/2406.06021