Image Super-Resolution with Guarantees via Conformalized Generative Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Adame, Eduardo, Csillag, Daniel, Goedert, Guilherme Tegoni
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917058543878144
author Adame, Eduardo
Csillag, Daniel
Goedert, Guilherme Tegoni
author_facet Adame, Eduardo
Csillag, Daniel
Goedert, Guilherme Tegoni
contents The increasing use of generative ML foundation models for image restoration tasks such as super-resolution calls for robust and interpretable uncertainty quantification methods. We address this need by presenting a novel approach based on conformal prediction techniques to create a 'confidence mask' capable of reliably and intuitively communicating where the generated image can be trusted. Our method is adaptable to any black-box generative model, including those locked behind an opaque API, requires only easily attainable data for calibration, and is highly customizable via the choice of a local image similarity metric. We prove strong theoretical guarantees for our method that span fidelity error control (according to our local image similarity metric), reconstruction quality, and robustness in the face of data leakage. Finally, we empirically evaluate these results and establish our method's solid performance.
format Preprint
id arxiv_https___arxiv_org_abs_2502_09664
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Image Super-Resolution with Guarantees via Conformalized Generative Models
Adame, Eduardo
Csillag, Daniel
Goedert, Guilherme Tegoni
Computer Vision and Pattern Recognition
Machine Learning
The increasing use of generative ML foundation models for image restoration tasks such as super-resolution calls for robust and interpretable uncertainty quantification methods. We address this need by presenting a novel approach based on conformal prediction techniques to create a 'confidence mask' capable of reliably and intuitively communicating where the generated image can be trusted. Our method is adaptable to any black-box generative model, including those locked behind an opaque API, requires only easily attainable data for calibration, and is highly customizable via the choice of a local image similarity metric. We prove strong theoretical guarantees for our method that span fidelity error control (according to our local image similarity metric), reconstruction quality, and robustness in the face of data leakage. Finally, we empirically evaluate these results and establish our method's solid performance.
title Image Super-Resolution with Guarantees via Conformalized Generative Models
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.09664