MoFRR: Mixture of Diffusion Models for Face Retouching Restoration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Jiaxin, Ying, Qichao, Qian, Zhenxing, Li, Sheng, Zhang, Runqi, Liu, Jian, Zhang, Xinpeng
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913960574320640
author Liu, Jiaxin
Ying, Qichao
Qian, Zhenxing
Li, Sheng
Zhang, Runqi
Liu, Jian
Zhang, Xinpeng
author_facet Liu, Jiaxin
Ying, Qichao
Qian, Zhenxing
Li, Sheng
Zhang, Runqi
Liu, Jian
Zhang, Xinpeng
contents The widespread use of face retouching on social media platforms raises concerns about the authenticity of face images. While existing methods focus on detecting face retouching, how to accurately recover the original faces from the retouched ones has yet to be answered. This paper introduces Face Retouching Restoration (FRR), a novel computer vision task aimed at restoring original faces from their retouched counterparts. FRR differs from traditional image restoration tasks by addressing the complex retouching operations with various types and degrees, which focuses more on the restoration of the low-frequency information of the faces. To tackle this challenge, we propose MoFRR, Mixture of Diffusion Models for FRR. Inspired by DeepSeek's expert isolation strategy, the MoFRR uses sparse activation of specialized experts handling distinct retouching types and the engagement of a shared expert dealing with universal retouching traces. Each specialized expert follows a dual-branch structure with a DDIM-based low-frequency branch guided by an Iterative Distortion Evaluation Module (IDEM) and a Cross-Attention-based High-Frequency branch (HFCAM) for detail refinement. Extensive experiments on a newly constructed face retouching dataset, RetouchingFFHQ++, demonstrate the effectiveness of MoFRR for FRR.
format Preprint
id arxiv_https___arxiv_org_abs_2507_19770
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MoFRR: Mixture of Diffusion Models for Face Retouching Restoration
Liu, Jiaxin
Ying, Qichao
Qian, Zhenxing
Li, Sheng
Zhang, Runqi
Liu, Jian
Zhang, Xinpeng
Computer Vision and Pattern Recognition
The widespread use of face retouching on social media platforms raises concerns about the authenticity of face images. While existing methods focus on detecting face retouching, how to accurately recover the original faces from the retouched ones has yet to be answered. This paper introduces Face Retouching Restoration (FRR), a novel computer vision task aimed at restoring original faces from their retouched counterparts. FRR differs from traditional image restoration tasks by addressing the complex retouching operations with various types and degrees, which focuses more on the restoration of the low-frequency information of the faces. To tackle this challenge, we propose MoFRR, Mixture of Diffusion Models for FRR. Inspired by DeepSeek's expert isolation strategy, the MoFRR uses sparse activation of specialized experts handling distinct retouching types and the engagement of a shared expert dealing with universal retouching traces. Each specialized expert follows a dual-branch structure with a DDIM-based low-frequency branch guided by an Iterative Distortion Evaluation Module (IDEM) and a Cross-Attention-based High-Frequency branch (HFCAM) for detail refinement. Extensive experiments on a newly constructed face retouching dataset, RetouchingFFHQ++, demonstrate the effectiveness of MoFRR for FRR.
title MoFRR: Mixture of Diffusion Models for Face Retouching Restoration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.19770