Confidence over Time: Confidence Calibration with Temporal Logic for Large Language Model Reasoning
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915739672248320 |
|---|---|
| author | Mao, Zhenjiang Venkat, Anirudhh Bisliouk, Artem Kothiyal, Akshat Subramanian, Sindhura Kumbakonam Singhu, Saithej Ruchkin, Ivan |
| author_facet | Mao, Zhenjiang Venkat, Anirudhh Bisliouk, Artem Kothiyal, Akshat Subramanian, Sindhura Kumbakonam Singhu, Saithej Ruchkin, Ivan |
| contents | Large Language Models (LLMs) increasingly rely on long-form, multi-step reasoning to solve complex tasks such as mathematical problem solving and scientific question answering. Despite strong performance, existing confidence estimation methods typically reduce an entire reasoning process to a single scalar score, ignoring how confidence evolves throughout the generation. As a result, these methods are often sensitive to superficial factors such as response length or verbosity, and struggle to distinguish correct reasoning from confidently stated errors. We propose to characterize the stepwise confidence signal using Signal Temporal Logic (STL). Using a discriminative STL mining procedure, we discover temporal formulas that distinguish confidence signals of correct and incorrect responses. Our analysis found that the STL patterns generalize across tasks, and numeric parameters exhibit sensitivity to individual questions. Based on these insights, we develop a confidence estimation approach that informs STL blocks with parameter hypernetworks. Experiments on multiple reasoning tasks show our confidence scores are more calibrated than the baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_13387 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Confidence over Time: Confidence Calibration with Temporal Logic for Large Language Model Reasoning Mao, Zhenjiang Venkat, Anirudhh Bisliouk, Artem Kothiyal, Akshat Subramanian, Sindhura Kumbakonam Singhu, Saithej Ruchkin, Ivan Computation and Language Machine Learning Large Language Models (LLMs) increasingly rely on long-form, multi-step reasoning to solve complex tasks such as mathematical problem solving and scientific question answering. Despite strong performance, existing confidence estimation methods typically reduce an entire reasoning process to a single scalar score, ignoring how confidence evolves throughout the generation. As a result, these methods are often sensitive to superficial factors such as response length or verbosity, and struggle to distinguish correct reasoning from confidently stated errors. We propose to characterize the stepwise confidence signal using Signal Temporal Logic (STL). Using a discriminative STL mining procedure, we discover temporal formulas that distinguish confidence signals of correct and incorrect responses. Our analysis found that the STL patterns generalize across tasks, and numeric parameters exhibit sensitivity to individual questions. Based on these insights, we develop a confidence estimation approach that informs STL blocks with parameter hypernetworks. Experiments on multiple reasoning tasks show our confidence scores are more calibrated than the baselines. |
| title | Confidence over Time: Confidence Calibration with Temporal Logic for Large Language Model Reasoning |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2601.13387 |