FlashFace: Human Image Personalization with High-fidelity Identity Preservation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911409546199040 |
|---|---|
| author | Zhang, Shilong Huang, Lianghua Chen, Xi Zhang, Yifei Wu, Zhi-Fan Feng, Yutong Wang, Wei Shen, Yujun Liu, Yu Luo, Ping |
| author_facet | Zhang, Shilong Huang, Lianghua Chen, Xi Zhang, Yifei Wu, Zhi-Fan Feng, Yutong Wang, Wei Shen, Yujun Liu, Yu Luo, Ping |
| contents | This work presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt. Our approach is distinguishable from existing human photo customization methods by higher-fidelity identity preservation and better instruction following, benefiting from two subtle designs. First, we encode the face identity into a series of feature maps instead of one image token as in prior arts, allowing the model to retain more details of the reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a disentangled integration strategy to balance the text and image guidance during the text-to-image generation process, alleviating the conflict between the reference faces and the text prompts (e.g., personalizing an adult into a "child" or an "elder"). Extensive experimental results demonstrate the effectiveness of our method on various applications, including human image personalization, face swapping under language prompts, making virtual characters into real people, etc. Project Page: https://jshilong.github.io/flashface-page. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_17008 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FlashFace: Human Image Personalization with High-fidelity Identity Preservation Zhang, Shilong Huang, Lianghua Chen, Xi Zhang, Yifei Wu, Zhi-Fan Feng, Yutong Wang, Wei Shen, Yujun Liu, Yu Luo, Ping Computer Vision and Pattern Recognition This work presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt. Our approach is distinguishable from existing human photo customization methods by higher-fidelity identity preservation and better instruction following, benefiting from two subtle designs. First, we encode the face identity into a series of feature maps instead of one image token as in prior arts, allowing the model to retain more details of the reference faces (e.g., scars, tattoos, and face shape ). Second, we introduce a disentangled integration strategy to balance the text and image guidance during the text-to-image generation process, alleviating the conflict between the reference faces and the text prompts (e.g., personalizing an adult into a "child" or an "elder"). Extensive experimental results demonstrate the effectiveness of our method on various applications, including human image personalization, face swapping under language prompts, making virtual characters into real people, etc. Project Page: https://jshilong.github.io/flashface-page. |
| title | FlashFace: Human Image Personalization with High-fidelity Identity Preservation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.17008 |