Cover Image

Position Paper On Diagnostic Uncertainty Estimation from Large Language Models: Next-Word Probability Is Not Pre-test Probability

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gao, Yanjun, Myers, Skatje, Chen, Shan, Dligach, Dmitriy, Miller, Timothy A, Bitterman, Danielle, Chen, Guanhua, Mayampurath, Anoop, Churpek, Matthew, Afshar, Majid
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Lessons Learned on Information Retrieval in Electronic Health Records: A Comparison of Embedding Models and Pooling Strategies
by: Myers, Skatje, et al.
Published: (2024)

Evaluating Retrieval-Augmented Generation vs. Long-Context Input for Clinical Reasoning over EHRs
by: Myers, Skatje, et al.
Published: (2025)

When Raw Data Prevails: Are Large Language Model Embeddings Effective in Numerical Data Representation for Medical Machine Learning Applications?
by: Gao, Yanjun, et al.
Published: (2024)

Simple Yet Effective: An Information-Theoretic Approach to Multi-LLM Uncertainty Quantification
by: Kruse, Maya, et al.
Published: (2025)

Improving Clinical NLP Performance through Language Model-Generated Synthetic Clinical Data
by: Chen, Shan, et al.
Published: (2024)

Brittleness and Promise: Knowledge Graph Based Reward Modeling for Diagnostic Reasoning
by: Khatwani, Saksham, et al.
Published: (2025)

Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Study
by: Gao, Yanjun, et al.
Published: (2023)

MoMA: A Mixture-of-Multimodal-Agents Architecture for Enhancing Clinical Prediction Modelling
by: Gao, Jifan, et al.
Published: (2025)

LogosKG: Hardware-Optimized Scalable and Interpretable Knowledge Graph Retrieval
by: Cheng, He, et al.
Published: (2026)

CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation
by: Yoon, WonJin, et al.
Published: (2026)

Using Letter Positional Probabilities to Assess Word Complexity
by: Dalvean, Michael
Published: (2024)

ID in School Media Centers: Possible or Probable? A Position Paper.
by: Naumer, Janet Noll, et al.
Published: (1981)

How to Compute the Probability of a Word
by: Pimentel, Tiago, et al.
Published: (2024)

The Manokhin Probability Matrix: A Diagnostic Framework for Classifier Probability Quality
by: Manokhin, Valery
Published: (2026)

debiaSAE: Benchmarking and Mitigating Vision-Language Model Bias
by: Sasse, Kuleen, et al.
Published: (2024)

Modal Semantics for Reasoning with Probability and Uncertainty
by: Guallart, Nino
Published: (2024)

Neural Conditional Probability for Uncertainty Quantification
by: Kostic, Vladimir R., et al.
Published: (2024)

Uncertainty Levels of Second-Order Probability
by: David Sundgren
Published: (2013)

The Proof of Convergence with Probability 1 in the Method of Expansion of Iterated Ito Stochastic Integrals Based on Generalized Multiple Fourier Series
by: Kuznetsov, Dmitriy F.
Published: (2020)

Probabilities Are All You Need: A Probability-Only Approach to Uncertainty Estimation in Large Language Models
by: Nguyen, Manh, et al.
Published: (2025)

TPA: Next Token Probability Attribution for Detecting Hallucinations in RAG
by: Lu, Pengqian, et al.
Published: (2025)

Probability Bracket Notation for Probability Modeling
by: Wang, Xing M., et al.
Published: (2025)

Convolution-based Probability Gradient Loss for Semantic Segmentation
by: Shan, Guohang, et al.
Published: (2024)

When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
by: Qi, Jirui, et al.
Published: (2025)

Sparse Autoencoder Features for Classifications and Transferability
by: Gallifant, Jack, et al.
Published: (2025)

KScope: A Framework for Characterizing the Knowledge Status of Language Models
by: Xiao, Yuxin, et al.
Published: (2025)

Probabilities
by: Ouvrard, Jean-Yves, et al.
Published: (2026)

Proof of Time: A Benchmark for Evaluating Scientific Idea Judgments
by: Ye, Bingyang, et al.
Published: (2026)

Verbalizing LLM's Higher-order Uncertainty via Imprecise Probabilities
by: Yang, Anita, et al.
Published: (2026)

Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions
by: Vasconcelos, Helena, et al.
Published: (2023)

Trajectory of Probabilities, Probability on Trajectories, and the Stochastic-Quantum Correspondence
by: Egri, Győző, et al.
Published: (2026)

Computing Inverses of Stieltjes Transforms of Probability Measures
by: Chen, James, et al.
Published: (2024)

Polymer Data Challenges in the AI Era: Bridging Gaps for Next-Generation Energy Materials
by: Zhao, Ying, et al.
Published: (2025)

Probability Surveys
Published: (2022)

Probability and Statistics
by: Mathai, Arak M., et al.
Published: (2022)

Sheaves of Probability
by: Biesel, Owen D.
Published: (2024)

Probability Trees
by: Mejía, Diego A., et al.
Published: (2025)

Decoherence and Probability
by: Dawid, Richard, et al.
Published: (2024)

Negative Probability
by: Polson, Nick, et al.
Published: (2024)

Natural Probability
by: Parker, Brett
Published: (2024)