Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917864595783680 |
|---|---|
| author | Ruggeri, Federico Misino, Eleonora Muti, Arianna Korre, Katerina Torroni, Paolo Barrón-Cedeño, Alberto |
| author_facet | Ruggeri, Federico Misino, Eleonora Muti, Arianna Korre, Katerina Torroni, Paolo Barrón-Cedeño, Alberto |
| contents | We introduce the Guideline-Centered Annotation Methodology (GCAM), a novel data annotation methodology designed to report the annotation guidelines associated with each data sample. Our approach addresses three key limitations of the standard prescriptive annotation methodology by reducing the information loss during annotation and ensuring adherence to guidelines. Furthermore, GCAM enables the efficient reuse of annotated data across multiple tasks. We evaluate GCAM in two ways: (i) through a human annotation study and (ii) an experimental evaluation with several machine learning models. Our results highlight the advantages of GCAM from multiple perspectives, demonstrating its potential to improve annotation quality and error analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_14099 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology Ruggeri, Federico Misino, Eleonora Muti, Arianna Korre, Katerina Torroni, Paolo Barrón-Cedeño, Alberto Computation and Language We introduce the Guideline-Centered Annotation Methodology (GCAM), a novel data annotation methodology designed to report the annotation guidelines associated with each data sample. Our approach addresses three key limitations of the standard prescriptive annotation methodology by reducing the information loss during annotation and ensuring adherence to guidelines. Furthermore, GCAM enables the efficient reuse of annotated data across multiple tasks. We evaluate GCAM in two ways: (i) through a human annotation study and (ii) an experimental evaluation with several machine learning models. Our results highlight the advantages of GCAM from multiple perspectives, demonstrating its potential to improve annotation quality and error analysis. |
| title | Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.14099 |