A Survey of Uncertainty Estimation Methods on Large Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xia, Zhiqiu, Xu, Jinxuan, Zhang, Yuqian, Liu, Hang
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918037510160384
author Xia, Zhiqiu
Xu, Jinxuan
Zhang, Yuqian
Liu, Hang
author_facet Xia, Zhiqiu
Xu, Jinxuan
Zhang, Yuqian
Liu, Hang
contents Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty estimation is the key method to address this challenge. While research efforts in uncertainty estimation are ramping up, there is a lack of comprehensive and dedicated surveys on LLM uncertainty estimation. This survey presents four major avenues of LLM uncertainty estimation. Furthermore, we perform extensive experimental evaluations across multiple methods and datasets. At last, we provide critical and promising future directions for LLM uncertainty estimation.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00172
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey of Uncertainty Estimation Methods on Large Language Models
Xia, Zhiqiu
Xu, Jinxuan
Zhang, Yuqian
Liu, Hang
Computation and Language
Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty estimation is the key method to address this challenge. While research efforts in uncertainty estimation are ramping up, there is a lack of comprehensive and dedicated surveys on LLM uncertainty estimation. This survey presents four major avenues of LLM uncertainty estimation. Furthermore, we perform extensive experimental evaluations across multiple methods and datasets. At last, we provide critical and promising future directions for LLM uncertainty estimation.
title A Survey of Uncertainty Estimation Methods on Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2503.00172