HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Jingkai, Miao, Wu, Gong, Jue, Chen, Zheng, Liu, Xing, Gu, Hong, Liu, Yutong, Zhang, Yulun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916756434452480
author Wang, Jingkai
Miao, Wu
Gong, Jue
Chen, Zheng
Liu, Xing
Gu, Hong
Liu, Yutong
Zhang, Yulun
author_facet Wang, Jingkai
Miao, Wu
Gong, Jue
Chen, Zheng
Liu, Xing
Gu, Hong
Liu, Yutong
Zhang, Yulun
contents Face restoration has achieved remarkable advancements through the years of development. However, ensuring that restored facial images exhibit high fidelity, preserve authentic features, and avoid introducing artifacts or biases remains a significant challenge. This highlights the need for models that are more "honest" in their reconstruction from low-quality inputs, accurately reflecting original characteristics. In this work, we propose HonestFace, a novel approach designed to restore faces with a strong emphasis on such honesty, particularly concerning identity consistency and texture realism. To achieve this, HonestFace incorporates several key components. First, we propose an identity embedder to effectively capture and preserve crucial identity features from both the low-quality input and multiple reference faces. Second, a masked face alignment method is presented to enhance fine-grained details and textural authenticity, thereby preventing the generation of patterned or overly synthetic textures and improving overall clarity. Furthermore, we present a new landmark-based evaluation metric. Based on affine transformation principles, this metric improves the accuracy compared to conventional L2 distance calculations for facial feature alignment. Leveraging these contributions within a one-step diffusion model framework, HonestFace delivers exceptional restoration results in terms of facial fidelity and realism. Extensive experiments demonstrate that our approach surpasses existing state-of-the-art methods, achieving superior performance in both visual quality and quantitative assessments. The code and pre-trained models will be made publicly available at https://github.com/jkwang28/HonestFace .
format Preprint
id arxiv_https___arxiv_org_abs_2505_18469
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model
Wang, Jingkai
Miao, Wu
Gong, Jue
Chen, Zheng
Liu, Xing
Gu, Hong
Liu, Yutong
Zhang, Yulun
Computer Vision and Pattern Recognition
Face restoration has achieved remarkable advancements through the years of development. However, ensuring that restored facial images exhibit high fidelity, preserve authentic features, and avoid introducing artifacts or biases remains a significant challenge. This highlights the need for models that are more "honest" in their reconstruction from low-quality inputs, accurately reflecting original characteristics. In this work, we propose HonestFace, a novel approach designed to restore faces with a strong emphasis on such honesty, particularly concerning identity consistency and texture realism. To achieve this, HonestFace incorporates several key components. First, we propose an identity embedder to effectively capture and preserve crucial identity features from both the low-quality input and multiple reference faces. Second, a masked face alignment method is presented to enhance fine-grained details and textural authenticity, thereby preventing the generation of patterned or overly synthetic textures and improving overall clarity. Furthermore, we present a new landmark-based evaluation metric. Based on affine transformation principles, this metric improves the accuracy compared to conventional L2 distance calculations for facial feature alignment. Leveraging these contributions within a one-step diffusion model framework, HonestFace delivers exceptional restoration results in terms of facial fidelity and realism. Extensive experiments demonstrate that our approach surpasses existing state-of-the-art methods, achieving superior performance in both visual quality and quantitative assessments. The code and pre-trained models will be made publicly available at https://github.com/jkwang28/HonestFace .
title HonestFace: Towards Honest Face Restoration with One-Step Diffusion Model
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.18469