Measurement-Constrained Sampling for Text-Prompted Blind Face Restoration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Wenjie, Zhang, Yulun, Gao, Guangwei, Guo, Heng, Ma, Zhanyu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908662056878080
author Li, Wenjie
Zhang, Yulun
Gao, Guangwei
Guo, Heng
Ma, Zhanyu
author_facet Li, Wenjie
Zhang, Yulun
Gao, Guangwei
Guo, Heng
Ma, Zhanyu
contents Blind face restoration (BFR) may correspond to multiple plausible high-quality (HQ) reconstructions under extremely low-quality (LQ) inputs. However, existing methods typically produce deterministic results, struggling to capture this one-to-many nature. In this paper, we propose a Measurement-Constrained Sampling (MCS) approach that enables diverse LQ face reconstructions conditioned on different textual prompts. Specifically, we formulate BFR as a measurement-constrained generative task by constructing an inverse problem through controlled degradations of coarse restorations, which allows posterior-guided sampling within text-to-image diffusion. Measurement constraints include both Forward Measurement, which ensures results align with input structures, and Reverse Measurement, which produces projection spaces, ensuring that the solution can align with various prompts. Experiments show that our MCS can generate prompt-aligned results and outperforms existing BFR methods. Codes will be released after acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2511_14213
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Measurement-Constrained Sampling for Text-Prompted Blind Face Restoration
Li, Wenjie
Zhang, Yulun
Gao, Guangwei
Guo, Heng
Ma, Zhanyu
Computer Vision and Pattern Recognition
Blind face restoration (BFR) may correspond to multiple plausible high-quality (HQ) reconstructions under extremely low-quality (LQ) inputs. However, existing methods typically produce deterministic results, struggling to capture this one-to-many nature. In this paper, we propose a Measurement-Constrained Sampling (MCS) approach that enables diverse LQ face reconstructions conditioned on different textual prompts. Specifically, we formulate BFR as a measurement-constrained generative task by constructing an inverse problem through controlled degradations of coarse restorations, which allows posterior-guided sampling within text-to-image diffusion. Measurement constraints include both Forward Measurement, which ensures results align with input structures, and Reverse Measurement, which produces projection spaces, ensuring that the solution can align with various prompts. Experiments show that our MCS can generate prompt-aligned results and outperforms existing BFR methods. Codes will be released after acceptance.
title Measurement-Constrained Sampling for Text-Prompted Blind Face Restoration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.14213