Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinement
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929608428879872 |
|---|---|
| author | Ramzan, Muhammad Umer Zia, Ali Khamis, Abdelwahed Elgharabawy, yman Liaqat, Ahmad Ali, Usman |
| author_facet | Ramzan, Muhammad Umer Zia, Ali Khamis, Abdelwahed Elgharabawy, yman Liaqat, Ahmad Ali, Usman |
| contents | This paper presents a novel deep-learning framework that significantly enhances the transformation of rudimentary face sketches into high-fidelity colour images. Employing a Convolutional Block Attention-based Auto-encoder Network (CA2N), our approach effectively captures and enhances critical facial features through a block attention mechanism within an encoder-decoder architecture. Subsequently, the framework utilises a noise-induced conditional Generative Adversarial Network (cGAN) process that allows the system to maintain high performance even on domains unseen during the training. These enhancements lead to considerable improvements in image realism and fidelity, with our model achieving superior performance metrics that outperform the best method by FID margin of 17, 23, and 38 on CelebAMask-HQ, CUHK, and CUFSF datasets; respectively. The model sets a new state-of-the-art in sketch-to-image generation, can generalize across sketch types, and offers a robust solution for applications such as criminal identification in law enforcement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_19005 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinement Ramzan, Muhammad Umer Zia, Ali Khamis, Abdelwahed Elgharabawy, yman Liaqat, Ahmad Ali, Usman Computer Vision and Pattern Recognition This paper presents a novel deep-learning framework that significantly enhances the transformation of rudimentary face sketches into high-fidelity colour images. Employing a Convolutional Block Attention-based Auto-encoder Network (CA2N), our approach effectively captures and enhances critical facial features through a block attention mechanism within an encoder-decoder architecture. Subsequently, the framework utilises a noise-induced conditional Generative Adversarial Network (cGAN) process that allows the system to maintain high performance even on domains unseen during the training. These enhancements lead to considerable improvements in image realism and fidelity, with our model achieving superior performance metrics that outperform the best method by FID margin of 17, 23, and 38 on CelebAMask-HQ, CUHK, and CUFSF datasets; respectively. The model sets a new state-of-the-art in sketch-to-image generation, can generalize across sketch types, and offers a robust solution for applications such as criminal identification in law enforcement. |
| title | Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinement |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.19005 |