NLG Evaluation: Past, Present, Future

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Reiter, Ehud
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911709190422528
author Reiter, Ehud
author_facet Reiter, Ehud
contents Natural Language Generation (NLG) evaluation has changed dramatically since 1990, and will continue to evolve in the future. In 1990, when NLG had close ties to linguistics, there was very little formal experimental evaluation in the modern sense. In 2026, when NLG is closely linked to machine learning, experimental evaluation is expected and indeed fundamental to research. Many evaluation techniques were developed over this period, including most recently LLM-as-Judge. I expect NLG evaluation will continue to evolve in the future. In particular, impact, qualitative, and safety evaluation will become more important as large numbers of people routinely use NLG technology.
format Preprint
id arxiv_https___arxiv_org_abs_2605_23715
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle NLG Evaluation: Past, Present, Future
Reiter, Ehud
Computation and Language
Natural Language Generation (NLG) evaluation has changed dramatically since 1990, and will continue to evolve in the future. In 1990, when NLG had close ties to linguistics, there was very little formal experimental evaluation in the modern sense. In 2026, when NLG is closely linked to machine learning, experimental evaluation is expected and indeed fundamental to research. Many evaluation techniques were developed over this period, including most recently LLM-as-Judge. I expect NLG evaluation will continue to evolve in the future. In particular, impact, qualitative, and safety evaluation will become more important as large numbers of people routinely use NLG technology.
title NLG Evaluation: Past, Present, Future
topic Computation and Language
url https://arxiv.org/abs/2605.23715