CritiCal: Can Critique Help LLM Uncertainty or Confidence Calibration?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914118759350272 |
|---|---|
| author | Zong, Qing Liu, Jiayu Zheng, Tianshi Li, Chunyang Xu, Baixuan Shi, Haochen Wang, Weiqi Wang, Zhaowei Chan, Chunkit Song, Yangqiu |
| author_facet | Zong, Qing Liu, Jiayu Zheng, Tianshi Li, Chunyang Xu, Baixuan Shi, Haochen Wang, Weiqi Wang, Zhaowei Chan, Chunkit Song, Yangqiu |
| contents | Accurate confidence calibration in Large Language Models (LLMs) is critical for safe use in high-stakes domains, where clear verbalized confidence enhances user trust. Traditional methods that mimic reference confidence expressions often fail to capture the reasoning needed for accurate confidence assessment. We propose natural language critiques as a solution, ideally suited for confidence calibration, as precise gold confidence labels are hard to obtain and often require multiple generations. This paper studies how natural language critiques can enhance verbalized confidence, addressing: (1) What to critique: uncertainty (question-focused) or confidence (answer-specific)? Analysis shows confidence suits multiple-choice tasks, while uncertainty excels in open-ended scenarios. (2) How to critique: self-critique or critique calibration training? We propose Self-Critique, enabling LLMs to critique and optimize their confidence beyond mere accuracy, and CritiCal, a novel Critique Calibration training method that leverages natural language critiques to improve confidence calibration, moving beyond direct numerical optimization. Experiments show that CritiCal significantly outperforms Self-Critique and other competitive baselines, even surpassing its teacher model, GPT-4o, in complex reasoning tasks. CritiCal also shows robust generalization in out-of-distribution settings, advancing LLM's reliability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_24505 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CritiCal: Can Critique Help LLM Uncertainty or Confidence Calibration? Zong, Qing Liu, Jiayu Zheng, Tianshi Li, Chunyang Xu, Baixuan Shi, Haochen Wang, Weiqi Wang, Zhaowei Chan, Chunkit Song, Yangqiu Computation and Language Accurate confidence calibration in Large Language Models (LLMs) is critical for safe use in high-stakes domains, where clear verbalized confidence enhances user trust. Traditional methods that mimic reference confidence expressions often fail to capture the reasoning needed for accurate confidence assessment. We propose natural language critiques as a solution, ideally suited for confidence calibration, as precise gold confidence labels are hard to obtain and often require multiple generations. This paper studies how natural language critiques can enhance verbalized confidence, addressing: (1) What to critique: uncertainty (question-focused) or confidence (answer-specific)? Analysis shows confidence suits multiple-choice tasks, while uncertainty excels in open-ended scenarios. (2) How to critique: self-critique or critique calibration training? We propose Self-Critique, enabling LLMs to critique and optimize their confidence beyond mere accuracy, and CritiCal, a novel Critique Calibration training method that leverages natural language critiques to improve confidence calibration, moving beyond direct numerical optimization. Experiments show that CritiCal significantly outperforms Self-Critique and other competitive baselines, even surpassing its teacher model, GPT-4o, in complex reasoning tasks. CritiCal also shows robust generalization in out-of-distribution settings, advancing LLM's reliability. |
| title | CritiCal: Can Critique Help LLM Uncertainty or Confidence Calibration? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.24505 |