Combining Generative and Geometry Priors for Wide-Angle Portrait Correction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Lan, Chen, Chaofeng, Li, Xiaoming, Yan, Zifei, Zuo, Wangmeng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913544561229824
author Yao, Lan
Chen, Chaofeng
Li, Xiaoming
Yan, Zifei
Zuo, Wangmeng
author_facet Yao, Lan
Chen, Chaofeng
Li, Xiaoming
Yan, Zifei
Zuo, Wangmeng
contents Wide-angle lens distortion in portrait photography presents a significant challenge for capturing photo-realistic and aesthetically pleasing images. Such distortions are especially noticeable in facial regions. In this work, we propose encapsulating the generative face prior as a guided natural manifold to facilitate the correction of facial regions. Moreover, a notable central symmetry relationship exists in the non-face background, yet it has not been explored in the correction process. This geometry prior motivates us to introduce a novel constraint to explicitly enforce symmetry throughout the correction process, thereby contributing to a more visually appealing and natural correction in the non-face region. Experiments demonstrate that our approach outperforms previous methods by a large margin, excelling not only in quantitative measures such as line straightness and shape consistency metrics but also in terms of perceptual visual quality. All the code and models are available at https://github.com/Dev-Mrha/DualPriorsCorrection.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09911
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Combining Generative and Geometry Priors for Wide-Angle Portrait Correction
Yao, Lan
Chen, Chaofeng
Li, Xiaoming
Yan, Zifei
Zuo, Wangmeng
Computer Vision and Pattern Recognition
Wide-angle lens distortion in portrait photography presents a significant challenge for capturing photo-realistic and aesthetically pleasing images. Such distortions are especially noticeable in facial regions. In this work, we propose encapsulating the generative face prior as a guided natural manifold to facilitate the correction of facial regions. Moreover, a notable central symmetry relationship exists in the non-face background, yet it has not been explored in the correction process. This geometry prior motivates us to introduce a novel constraint to explicitly enforce symmetry throughout the correction process, thereby contributing to a more visually appealing and natural correction in the non-face region. Experiments demonstrate that our approach outperforms previous methods by a large margin, excelling not only in quantitative measures such as line straightness and shape consistency metrics but also in terms of perceptual visual quality. All the code and models are available at https://github.com/Dev-Mrha/DualPriorsCorrection.
title Combining Generative and Geometry Priors for Wide-Angle Portrait Correction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.09911