Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.19690 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909574583287808 |
|---|---|
| author | Zhao, Yiming Guo, Dewen Lian, Zhouhui Gao, Yue Han, Jianhong Feng, Jie Wang, Guoping Zhou, Bingfeng Li, Sheng |
| author_facet | Zhao, Yiming Guo, Dewen Lian, Zhouhui Gao, Yue Han, Jianhong Feng, Jie Wang, Guoping Zhou, Bingfeng Li, Sheng |
| contents | To bridge the gap between artists and non-specialists, we present a unified framework, Neural-Polyptych, to facilitate the creation of expansive, high-resolution paintings by seamlessly incorporating interactive hand-drawn sketches with fragments from original paintings. We have designed a multi-scale GAN-based architecture to decompose the generation process into two parts, each responsible for identifying global and local features. To enhance the fidelity of semantic details generated from users' sketched outlines, we introduce a Correspondence Attention module utilizing our Reference Bank strategy. This ensures the creation of high-quality, intricately detailed elements within the artwork. The final result is achieved by carefully blending these local elements while preserving coherent global consistency. Consequently, this methodology enables the production of digital paintings at megapixel scale, accommodating diverse artistic expressions and enabling users to recreate content in a controlled manner. We validate our approach to diverse genres of both Eastern and Western paintings. Applications such as large painting extension, texture shuffling, genre switching, mural art restoration, and recomposition can be successfully based on our framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_19690 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Neural-Polyptych: Content Controllable Painting Recreation for Diverse Genres Zhao, Yiming Guo, Dewen Lian, Zhouhui Gao, Yue Han, Jianhong Feng, Jie Wang, Guoping Zhou, Bingfeng Li, Sheng Computer Vision and Pattern Recognition Graphics To bridge the gap between artists and non-specialists, we present a unified framework, Neural-Polyptych, to facilitate the creation of expansive, high-resolution paintings by seamlessly incorporating interactive hand-drawn sketches with fragments from original paintings. We have designed a multi-scale GAN-based architecture to decompose the generation process into two parts, each responsible for identifying global and local features. To enhance the fidelity of semantic details generated from users' sketched outlines, we introduce a Correspondence Attention module utilizing our Reference Bank strategy. This ensures the creation of high-quality, intricately detailed elements within the artwork. The final result is achieved by carefully blending these local elements while preserving coherent global consistency. Consequently, this methodology enables the production of digital paintings at megapixel scale, accommodating diverse artistic expressions and enabling users to recreate content in a controlled manner. We validate our approach to diverse genres of both Eastern and Western paintings. Applications such as large painting extension, texture shuffling, genre switching, mural art restoration, and recomposition can be successfully based on our framework. |
| title | Neural-Polyptych: Content Controllable Painting Recreation for Diverse Genres |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2409.19690 |