Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.19444 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913051156938752 |
|---|---|
| author | Zollo, Thomas Wang, Jimmy Zemel, Richard |
| author_facet | Zollo, Thomas Wang, Jimmy Zemel, Richard |
| contents | Reasoning language models can solve increasingly complex tasks, but struggle to produce the calibrated confidence estimates necessary for reliable deployment. Existing calibration methods usually depend on labels or repeated sampling at inference time, making them impractical in many settings. We introduce a method for unsupervised confidence calibration of reasoning LLMs when only a single generation is available at inference time. Our approach uses offline sampling on unlabeled data to derive a self-consistency-based proxy target, then distills this signal into a lightweight deployment-time confidence predictor. In a broad evaluation across 5 math and question-answering tasks using 9 reasoning models, our method substantially outperforms baselines, including under distribution shift, and improves downstream performance in selective prediction and simulated downstream decision-making. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_19444 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Unsupervised Confidence Calibration for Reasoning LLMs from a Single Generation Zollo, Thomas Wang, Jimmy Zemel, Richard Machine Learning Reasoning language models can solve increasingly complex tasks, but struggle to produce the calibrated confidence estimates necessary for reliable deployment. Existing calibration methods usually depend on labels or repeated sampling at inference time, making them impractical in many settings. We introduce a method for unsupervised confidence calibration of reasoning LLMs when only a single generation is available at inference time. Our approach uses offline sampling on unlabeled data to derive a self-consistency-based proxy target, then distills this signal into a lightweight deployment-time confidence predictor. In a broad evaluation across 5 math and question-answering tasks using 9 reasoning models, our method substantially outperforms baselines, including under distribution shift, and improves downstream performance in selective prediction and simulated downstream decision-making. |
| title | Unsupervised Confidence Calibration for Reasoning LLMs from a Single Generation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2604.19444 |