Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Dataset
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913843595182080 |
|---|---|
| author | Dong, Zhao Chen, Ka Lv, Zhaoyang Yu, Hong-Xing Zhang, Yunzhi Zhang, Cheng Zhu, Yufeng Tian, Stephen Li, Zhengqin Moffatt, Geordie Christofferson, Sean Fort, James Pan, Xiaqing Yan, Mingfei Wu, Jiajun Ren, Carl Yuheng Newcombe, Richard |
| author_facet | Dong, Zhao Chen, Ka Lv, Zhaoyang Yu, Hong-Xing Zhang, Yunzhi Zhang, Cheng Zhu, Yufeng Tian, Stephen Li, Zhengqin Moffatt, Geordie Christofferson, Sean Fort, James Pan, Xiaqing Yan, Mingfei Wu, Jiajun Ren, Carl Yuheng Newcombe, Richard |
| contents | We introduce the Digital Twin Catalog (DTC), a new large-scale photorealistic 3D object digital twin dataset. A digital twin of a 3D object is a highly detailed, virtually indistinguishable representation of a physical object, accurately capturing its shape, appearance, physical properties, and other attributes. Recent advances in neural-based 3D reconstruction and inverse rendering have significantly improved the quality of 3D object reconstruction. Despite these advancements, there remains a lack of a large-scale, digital twin-quality real-world dataset and benchmark that can quantitatively assess and compare the performance of different reconstruction methods, as well as improve reconstruction quality through training or fine-tuning. Moreover, to democratize 3D digital twin creation, it is essential to integrate creation techniques with next-generation egocentric computing platforms, such as AR glasses. Currently, there is no dataset available to evaluate 3D object reconstruction using egocentric captured images. To address these gaps, the DTC dataset features 2,000 scanned digital twin-quality 3D objects, along with image sequences captured under different lighting conditions using DSLR cameras and egocentric AR glasses. This dataset establishes the first comprehensive real-world evaluation benchmark for 3D digital twin creation tasks, offering a robust foundation for comparing and improving existing reconstruction methods. The DTC dataset is already released at https://www.projectaria.com/datasets/dtc/ and we will also make the baseline evaluations open-source. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_08541 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Dataset Dong, Zhao Chen, Ka Lv, Zhaoyang Yu, Hong-Xing Zhang, Yunzhi Zhang, Cheng Zhu, Yufeng Tian, Stephen Li, Zhengqin Moffatt, Geordie Christofferson, Sean Fort, James Pan, Xiaqing Yan, Mingfei Wu, Jiajun Ren, Carl Yuheng Newcombe, Richard Graphics Artificial Intelligence Computer Vision and Pattern Recognition Robotics We introduce the Digital Twin Catalog (DTC), a new large-scale photorealistic 3D object digital twin dataset. A digital twin of a 3D object is a highly detailed, virtually indistinguishable representation of a physical object, accurately capturing its shape, appearance, physical properties, and other attributes. Recent advances in neural-based 3D reconstruction and inverse rendering have significantly improved the quality of 3D object reconstruction. Despite these advancements, there remains a lack of a large-scale, digital twin-quality real-world dataset and benchmark that can quantitatively assess and compare the performance of different reconstruction methods, as well as improve reconstruction quality through training or fine-tuning. Moreover, to democratize 3D digital twin creation, it is essential to integrate creation techniques with next-generation egocentric computing platforms, such as AR glasses. Currently, there is no dataset available to evaluate 3D object reconstruction using egocentric captured images. To address these gaps, the DTC dataset features 2,000 scanned digital twin-quality 3D objects, along with image sequences captured under different lighting conditions using DSLR cameras and egocentric AR glasses. This dataset establishes the first comprehensive real-world evaluation benchmark for 3D digital twin creation tasks, offering a robust foundation for comparing and improving existing reconstruction methods. The DTC dataset is already released at https://www.projectaria.com/datasets/dtc/ and we will also make the baseline evaluations open-source. |
| title | Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Dataset |
| topic | Graphics Artificial Intelligence Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2504.08541 |