Conf-Gen: Conformal Uncertainty Quantification for Generative Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914609655447552 |
|---|---|
| author | Loaiza-Ganem, Gabriel Zhang, Kevin Cui, Wei Law, Marc T. Leung, Kin Kwan |
| author_facet | Loaiza-Ganem, Gabriel Zhang, Kevin Cui, Wei Law, Marc T. Leung, Kin Kwan |
| contents | Conformal prediction (CP) and its extension, conformal risk control (CRC), are established frameworks for quantifying uncertainty in supervised machine learning through formal guarantees. However, recent breakthroughs in artificial intelligence (AI) have been driven by unsupervised generative models, such as large language models (LLMs) and image generators, which are not directly compatible with CP or CRC. In this work we introduce conformal generation (Conf-Gen), a general framework adapting CRC to generative tasks while relaxing its theoretical assumptions. Conf-Gen unifies and generalizes previous attempts to apply CP to LLMs, and extends conformal methodology to entirely new domains. We demonstrate the flexibility of Conf-Gen through some novel applications, including obtaining conformal guarantees on: image generators producing non-memorized images, conversational AI systems having asked enough clarifying questions, and the output of AI agents being correct. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_28920 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Conf-Gen: Conformal Uncertainty Quantification for Generative Models Loaiza-Ganem, Gabriel Zhang, Kevin Cui, Wei Law, Marc T. Leung, Kin Kwan Machine Learning Artificial Intelligence Conformal prediction (CP) and its extension, conformal risk control (CRC), are established frameworks for quantifying uncertainty in supervised machine learning through formal guarantees. However, recent breakthroughs in artificial intelligence (AI) have been driven by unsupervised generative models, such as large language models (LLMs) and image generators, which are not directly compatible with CP or CRC. In this work we introduce conformal generation (Conf-Gen), a general framework adapting CRC to generative tasks while relaxing its theoretical assumptions. Conf-Gen unifies and generalizes previous attempts to apply CP to LLMs, and extends conformal methodology to entirely new domains. We demonstrate the flexibility of Conf-Gen through some novel applications, including obtaining conformal guarantees on: image generators producing non-memorized images, conversational AI systems having asked enough clarifying questions, and the output of AI agents being correct. |
| title | Conf-Gen: Conformal Uncertainty Quantification for Generative Models |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2605.28920 |