Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2310.05375 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909358078558208 |
|---|---|
| author | Zeng, Bohan Li, Shanglin Feng, Yutang Yang, Ling Li, Hong Gao, Sicheng Liu, Jiaming He, Conghui Zhang, Wentao Liu, Jianzhuang Zhang, Baochang Yan, Shuicheng |
| author_facet | Zeng, Bohan Li, Shanglin Feng, Yutang Yang, Ling Li, Hong Gao, Sicheng Liu, Jiaming He, Conghui Zhang, Wentao Liu, Jianzhuang Zhang, Baochang Yan, Shuicheng |
| contents | Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and photorealistic textured objects. However, the appearance of 3D objects produced by such text-to-3D models is often unpredictable, and it is hard for single-image-to-3D methods to deal with images lacking a clear subject, complicating the generation of appearance-controllable 3D objects from complex images. To address these challenges, we present IPDreamer, a novel method that captures intricate appearance features from complex $\textbf{I}$mage $\textbf{P}$rompts and aligns the synthesized 3D object with these extracted features, enabling high-fidelity, appearance-controllable 3D object generation. Our experiments demonstrate that IPDreamer consistently generates high-quality 3D objects that align with both the textual and complex image prompts, highlighting its promising capability in appearance-controlled, complex 3D object generation. Our code is available at https://github.com/zengbohan0217/IPDreamer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_05375 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | IPDreamer: Appearance-Controllable 3D Object Generation with Complex Image Prompts Zeng, Bohan Li, Shanglin Feng, Yutang Yang, Ling Li, Hong Gao, Sicheng Liu, Jiaming He, Conghui Zhang, Wentao Liu, Jianzhuang Zhang, Baochang Yan, Shuicheng Computer Vision and Pattern Recognition Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and photorealistic textured objects. However, the appearance of 3D objects produced by such text-to-3D models is often unpredictable, and it is hard for single-image-to-3D methods to deal with images lacking a clear subject, complicating the generation of appearance-controllable 3D objects from complex images. To address these challenges, we present IPDreamer, a novel method that captures intricate appearance features from complex $\textbf{I}$mage $\textbf{P}$rompts and aligns the synthesized 3D object with these extracted features, enabling high-fidelity, appearance-controllable 3D object generation. Our experiments demonstrate that IPDreamer consistently generates high-quality 3D objects that align with both the textual and complex image prompts, highlighting its promising capability in appearance-controlled, complex 3D object generation. Our code is available at https://github.com/zengbohan0217/IPDreamer. |
| title | IPDreamer: Appearance-Controllable 3D Object Generation with Complex Image Prompts |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2310.05375 |