Image-to-Image Translation with Disentangled Latent Vectors for Face Editing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910898363301888 |
|---|---|
| author | Dalva, Yusuf Pehlivan, Hamza Moran, Cansu Hatipoğlu, Öykü Irmak Dündar, Ayşegül |
| author_facet | Dalva, Yusuf Pehlivan, Hamza Moran, Cansu Hatipoğlu, Öykü Irmak Dündar, Ayşegül |
| contents | We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with controllable strength and disentanglement in the representations of attributes to preserve the other attributes during edits. For this goal, inspired by the latent space factorization works of fixed pretrained GANs, we design the attribute editing by latent space factorization, and for each attribute, we learn a linear direction that is orthogonal to the others. We train these directions with orthogonality constraints and disentanglement losses. To project images to semantically organized latent spaces, we set an encoder-decoder architecture with attention-based skip connections. We extensively compare with previous image translation algorithms and editing with pretrained GAN works. Our extensive experiments show that our method significantly improves over the state-of-the-arts. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2301_04628 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Image-to-Image Translation with Disentangled Latent Vectors for Face Editing Dalva, Yusuf Pehlivan, Hamza Moran, Cansu Hatipoğlu, Öykü Irmak Dündar, Ayşegül Computer Vision and Pattern Recognition We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with controllable strength and disentanglement in the representations of attributes to preserve the other attributes during edits. For this goal, inspired by the latent space factorization works of fixed pretrained GANs, we design the attribute editing by latent space factorization, and for each attribute, we learn a linear direction that is orthogonal to the others. We train these directions with orthogonality constraints and disentanglement losses. To project images to semantically organized latent spaces, we set an encoder-decoder architecture with attention-based skip connections. We extensively compare with previous image translation algorithms and editing with pretrained GAN works. Our extensive experiments show that our method significantly improves over the state-of-the-arts. |
| title | Image-to-Image Translation with Disentangled Latent Vectors for Face Editing |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2301.04628 |