Shape2Animal: Creative Animal Generation from Natural Silhouettes
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909018652409856 |
|---|---|
| author | Tran, Quoc-Duy Vo, Anh-Tuan Vo, Dinh-Khoi Nguyen, Tam V. Tran, Minh-Triet Le, Trung-Nghia |
| author_facet | Tran, Quoc-Duy Vo, Anh-Tuan Vo, Dinh-Khoi Nguyen, Tam V. Tran, Minh-Triet Le, Trung-Nghia |
| contents | Humans possess a unique ability to perceive meaningful patterns in ambiguous stimuli, a cognitive phenomenon known as pareidolia. This paper introduces Shape2Animal framework to mimics this imaginative capacity by reinterpreting natural object silhouettes, such as clouds, stones, or flames, as plausible animal forms. Our automated framework first performs open-vocabulary segmentation to extract object silhouette and interprets semantically appropriate animal concepts using vision-language models. It then synthesizes an animal image that conforms to the input shape, leveraging text-to-image diffusion model and seamlessly blends it into the original scene to generate visually coherent and spatially consistent compositions. We evaluated Shape2Animal on a diverse set of real-world inputs, demonstrating its robustness and creative potential. Our Shape2Animal can offer new opportunities for visual storytelling, educational content, digital art, and interactive media design. Our project page is here: https://shape2image.github.io |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_20616 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Shape2Animal: Creative Animal Generation from Natural Silhouettes Tran, Quoc-Duy Vo, Anh-Tuan Vo, Dinh-Khoi Nguyen, Tam V. Tran, Minh-Triet Le, Trung-Nghia Computer Vision and Pattern Recognition Humans possess a unique ability to perceive meaningful patterns in ambiguous stimuli, a cognitive phenomenon known as pareidolia. This paper introduces Shape2Animal framework to mimics this imaginative capacity by reinterpreting natural object silhouettes, such as clouds, stones, or flames, as plausible animal forms. Our automated framework first performs open-vocabulary segmentation to extract object silhouette and interprets semantically appropriate animal concepts using vision-language models. It then synthesizes an animal image that conforms to the input shape, leveraging text-to-image diffusion model and seamlessly blends it into the original scene to generate visually coherent and spatially consistent compositions. We evaluated Shape2Animal on a diverse set of real-world inputs, demonstrating its robustness and creative potential. Our Shape2Animal can offer new opportunities for visual storytelling, educational content, digital art, and interactive media design. Our project page is here: https://shape2image.github.io |
| title | Shape2Animal: Creative Animal Generation from Natural Silhouettes |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.20616 |