Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.16922 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908584743272448 |
|---|---|
| author | Yang, Ruihan Zhang, Caiqi Zhang, Zhisong Huang, Xinting Yu, Dong Collier, Nigel Yang, Deqing |
| author_facet | Yang, Ruihan Zhang, Caiqi Zhang, Zhisong Huang, Xinting Yu, Dong Collier, Nigel Yang, Deqing |
| contents | Large Language Models (LLMs) are prone to hallucination, particularly in long-form generations. A promising direction to mitigate hallucination is to teach LLMs to express uncertainty explicitly when they lack sufficient knowledge. However, existing work lacks direct and fair evaluation of LLMs' ability to express uncertainty effectively in long-form generation. To address this gap, we first introduce UNCLE, a benchmark designed to evaluate uncertainty expression in both long- and short-form question answering (QA). UNCLE covers five domains and includes more than 1,000 entities, each with paired short- and long-form QA items. Our dataset is the first to directly link short- and long-form QA through aligned questions and gold-standard answers. Along with UNCLE, we propose a suite of new metrics to assess the models' capabilities to selectively express uncertainty. We then demonstrate that current models fail to convey uncertainty appropriately in long-form generation. We further explore both prompt-based and training-based methods to improve models' performance, with the training-based methods yielding greater gains. Further analysis of alignment gaps between short- and long-form uncertainty expression highlights promising directions for future research using UNCLE. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16922 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation Yang, Ruihan Zhang, Caiqi Zhang, Zhisong Huang, Xinting Yu, Dong Collier, Nigel Yang, Deqing Computation and Language Large Language Models (LLMs) are prone to hallucination, particularly in long-form generations. A promising direction to mitigate hallucination is to teach LLMs to express uncertainty explicitly when they lack sufficient knowledge. However, existing work lacks direct and fair evaluation of LLMs' ability to express uncertainty effectively in long-form generation. To address this gap, we first introduce UNCLE, a benchmark designed to evaluate uncertainty expression in both long- and short-form question answering (QA). UNCLE covers five domains and includes more than 1,000 entities, each with paired short- and long-form QA items. Our dataset is the first to directly link short- and long-form QA through aligned questions and gold-standard answers. Along with UNCLE, we propose a suite of new metrics to assess the models' capabilities to selectively express uncertainty. We then demonstrate that current models fail to convey uncertainty appropriately in long-form generation. We further explore both prompt-based and training-based methods to improve models' performance, with the training-based methods yielding greater gains. Further analysis of alignment gaps between short- and long-form uncertainty expression highlights promising directions for future research using UNCLE. |
| title | UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2505.16922 |