An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917267810287616 |
|---|---|
| author | Goldin, Gili Wigderson, Shira Rabinovich, Ella Wintner, Shuly |
| author_facet | Goldin, Gili Wigderson, Shira Rabinovich, Ella Wintner, Shuly |
| contents | Factuality assesses the extent to which a language utterance relates to real-world information; it determines whether utterances correspond to facts, possibilities, or imaginary situations, and as such, it is instrumental for fact checking. Factuality is a complex notion that relies on multiple linguistic signals, and has been studied in various disciplines.
We present a complex, multi-faceted annotation scheme of factuality that combines concepts from a variety of previous works. We developed the scheme for Hebrew, but we trust that it can be adapted to other languages. We also present a set of almost 5,000 sentences in the domain of parliamentary discourse that we manually annotated according to this scheme. We report on inter-annotator agreement, and experiment with various approaches to automatically predict (some features of) the scheme, in order to extend the annotation to a large corpus. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_26406 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings Goldin, Gili Wigderson, Shira Rabinovich, Ella Wintner, Shuly Computation and Language Factuality assesses the extent to which a language utterance relates to real-world information; it determines whether utterances correspond to facts, possibilities, or imaginary situations, and as such, it is instrumental for fact checking. Factuality is a complex notion that relies on multiple linguistic signals, and has been studied in various disciplines. We present a complex, multi-faceted annotation scheme of factuality that combines concepts from a variety of previous works. We developed the scheme for Hebrew, but we trust that it can be adapted to other languages. We also present a set of almost 5,000 sentences in the domain of parliamentary discourse that we manually annotated according to this scheme. We report on inter-annotator agreement, and experiment with various approaches to automatically predict (some features of) the scheme, in order to extend the annotation to a large corpus. |
| title | An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2509.26406 |