FFaceNeRF: Few-shot Face Editing in Neural Radiance Fields

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yun, Kwan, Kim, Chaelin, Shin, Hangyeul, Noh, Junyong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909547417829376
author Yun, Kwan
Kim, Chaelin
Shin, Hangyeul
Noh, Junyong
author_facet Yun, Kwan
Kim, Chaelin
Shin, Hangyeul
Noh, Junyong
contents Recent 3D face editing methods using masks have produced high-quality edited images by leveraging Neural Radiance Fields (NeRF). Despite their impressive performance, existing methods often provide limited user control due to the use of pre-trained segmentation masks. To utilize masks with a desired layout, an extensive training dataset is required, which is challenging to gather. We present FFaceNeRF, a NeRF-based face editing technique that can overcome the challenge of limited user control due to the use of fixed mask layouts. Our method employs a geometry adapter with feature injection, allowing for effective manipulation of geometry attributes. Additionally, we adopt latent mixing for tri-plane augmentation, which enables training with a few samples. This facilitates rapid model adaptation to desired mask layouts, crucial for applications in fields like personalized medical imaging or creative face editing. Our comparative evaluations demonstrate that FFaceNeRF surpasses existing mask based face editing methods in terms of flexibility, control, and generated image quality, paving the way for future advancements in customized and high-fidelity 3D face editing. The code is available on the {\href{https://kwanyun.github.io/FFaceNeRF_page/}{project-page}}.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17095
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FFaceNeRF: Few-shot Face Editing in Neural Radiance Fields
Yun, Kwan
Kim, Chaelin
Shin, Hangyeul
Noh, Junyong
Graphics
Artificial Intelligence
Computer Vision and Pattern Recognition
68T45, 68U05
I.3.3; I.3.8
Recent 3D face editing methods using masks have produced high-quality edited images by leveraging Neural Radiance Fields (NeRF). Despite their impressive performance, existing methods often provide limited user control due to the use of pre-trained segmentation masks. To utilize masks with a desired layout, an extensive training dataset is required, which is challenging to gather. We present FFaceNeRF, a NeRF-based face editing technique that can overcome the challenge of limited user control due to the use of fixed mask layouts. Our method employs a geometry adapter with feature injection, allowing for effective manipulation of geometry attributes. Additionally, we adopt latent mixing for tri-plane augmentation, which enables training with a few samples. This facilitates rapid model adaptation to desired mask layouts, crucial for applications in fields like personalized medical imaging or creative face editing. Our comparative evaluations demonstrate that FFaceNeRF surpasses existing mask based face editing methods in terms of flexibility, control, and generated image quality, paving the way for future advancements in customized and high-fidelity 3D face editing. The code is available on the {\href{https://kwanyun.github.io/FFaceNeRF_page/}{project-page}}.
title FFaceNeRF: Few-shot Face Editing in Neural Radiance Fields
topic Graphics
Artificial Intelligence
Computer Vision and Pattern Recognition
68T45, 68U05
I.3.3; I.3.8
url https://arxiv.org/abs/2503.17095