LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913251437051904 |
|---|---|
| author | Choi, Changho Kim, Minho Lee, Junhyeok Song, Hyoung-Kyu Kim, Younggeun Kim, Seungryong |
| author_facet | Choi, Changho Kim, Minho Lee, Junhyeok Song, Hyoung-Kyu Kim, Younggeun Kim, Seungryong |
| contents | We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained models, with the training procedure also being fast and straightforward. The loss objective consists of only three terms, and can effectively control the face swap results between source and target images. By attaching a pre-trained GAN inversion model independent to the model and using the StyleGAN2 generator, our model produces photorealistic and high-resolution images comparable to other competitive face swap models. We show that our framework is applicable to other generators such as StyleNeRF, paving a way to 3D-aware face swapping and is also compatible with other downstream StyleGAN2 generator tasks. The source code and models can be found at \url{https://github.com/usingcolor/LatentSwap}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_18351 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping Choi, Changho Kim, Minho Lee, Junhyeok Song, Hyoung-Kyu Kim, Younggeun Kim, Seungryong Computer Vision and Pattern Recognition We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained models, with the training procedure also being fast and straightforward. The loss objective consists of only three terms, and can effectively control the face swap results between source and target images. By attaching a pre-trained GAN inversion model independent to the model and using the StyleGAN2 generator, our model produces photorealistic and high-resolution images comparable to other competitive face swap models. We show that our framework is applicable to other generators such as StyleNeRF, paving a way to 3D-aware face swapping and is also compatible with other downstream StyleGAN2 generator tasks. The source code and models can be found at \url{https://github.com/usingcolor/LatentSwap}. |
| title | LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2402.18351 |