factgenie: A Framework for Span-based Evaluation of Generated Texts
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910541622018048 |
|---|---|
| author | Kasner, Zdeněk Plátek, Ondřej Schmidtová, Patrícia Balloccu, Simone Dušek, Ondřej |
| author_facet | Kasner, Zdeněk Plátek, Ondřej Schmidtová, Patrícia Balloccu, Simone Dušek, Ondřej |
| contents | We present factgenie: a framework for annotating and visualizing word spans in textual model outputs. Annotations can capture various span-based phenomena such as semantic inaccuracies or irrelevant text. With factgenie, the annotations can be collected both from human crowdworkers and large language models. Our framework consists of a web interface for data visualization and gathering text annotations, powered by an easily extensible codebase. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_17863 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | factgenie: A Framework for Span-based Evaluation of Generated Texts Kasner, Zdeněk Plátek, Ondřej Schmidtová, Patrícia Balloccu, Simone Dušek, Ondřej Computation and Language We present factgenie: a framework for annotating and visualizing word spans in textual model outputs. Annotations can capture various span-based phenomena such as semantic inaccuracies or irrelevant text. With factgenie, the annotations can be collected both from human crowdworkers and large language models. Our framework consists of a web interface for data visualization and gathering text annotations, powered by an easily extensible codebase. |
| title | factgenie: A Framework for Span-based Evaluation of Generated Texts |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2407.17863 |