Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Chenghao, Zhang, Chaoning, Cho, Joseph, Waghwase, Atish, Lee, Lik-Hang, Rameau, Francois, Yang, Yang, Bae, Sung-Ho, Hong, Choong Seon
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910665496592384
author Li, Chenghao
Zhang, Chaoning
Cho, Joseph
Waghwase, Atish
Lee, Lik-Hang
Rameau, Francois
Yang, Yang
Bae, Sung-Ho
Hong, Choong Seon
author_facet Li, Chenghao
Zhang, Chaoning
Cho, Joseph
Waghwase, Atish
Lee, Lik-Hang
Rameau, Francois
Yang, Yang
Bae, Sung-Ho
Hong, Choong Seon
contents Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in text-to-image and 3D modeling technologies, like neural radiance field (NeRF), text-to-3D has emerged as a nascent yet highly active research field. Our work conducts a comprehensive survey on this topic and follows up on subsequent research progress in the overall field, aiming to help readers interested in this direction quickly catch up with its rapid development. First, we introduce 3D data representations, including both Structured and non-Structured data. Building on this pre-requisite, we introduce various core technologies to achieve satisfactory text-to-3D results. Additionally, we present mainstream baselines and research directions in recent text-to-3D technology, including fidelity, efficiency, consistency, controllability, diversity, and applicability. Furthermore, we summarize the usage of text-to-3D technology in various applications, including avatar generation, texture generation, scene generation and 3D editing. Finally, we discuss the agenda for the future development of text-to-3D.
format Preprint
id arxiv_https___arxiv_org_abs_2305_06131
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era
Li, Chenghao
Zhang, Chaoning
Cho, Joseph
Waghwase, Atish
Lee, Lik-Hang
Rameau, Francois
Yang, Yang
Bae, Sung-Ho
Hong, Choong Seon
Computer Vision and Pattern Recognition
Generative AI has made significant progress in recent years, with text-guided content generation being the most practical as it facilitates interaction between human instructions and AI-generated content (AIGC). Thanks to advancements in text-to-image and 3D modeling technologies, like neural radiance field (NeRF), text-to-3D has emerged as a nascent yet highly active research field. Our work conducts a comprehensive survey on this topic and follows up on subsequent research progress in the overall field, aiming to help readers interested in this direction quickly catch up with its rapid development. First, we introduce 3D data representations, including both Structured and non-Structured data. Building on this pre-requisite, we introduce various core technologies to achieve satisfactory text-to-3D results. Additionally, we present mainstream baselines and research directions in recent text-to-3D technology, including fidelity, efficiency, consistency, controllability, diversity, and applicability. Furthermore, we summarize the usage of text-to-3D technology in various applications, including avatar generation, texture generation, scene generation and 3D editing. Finally, we discuss the agenda for the future development of text-to-3D.
title Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2305.06131