Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.11033 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912156734193664 |
|---|---|
| author | Han, Huijun Liang, Yongqing Zhou, Yuanlong Wang, Wenping Rojas-Munoz, Edgar J. Li, Xin |
| author_facet | Han, Huijun Liang, Yongqing Zhou, Yuanlong Wang, Wenping Rojas-Munoz, Edgar J. Li, Xin |
| contents | Creating realistic VR experiences is challenging due to the labor-intensive process of accurately replicating real-world details into virtual scenes, highlighting the need for automated methods that maintain spatial accuracy and provide design flexibility. In this paper, we propose AURORA, a novel method that leverages RGB-D images to automatically generate both purely virtual reality (VR) scenes and VR scenes combined with real-world elements. This approach can benefit designers by streamlining the process of converting real-world details into virtual scenes. AURORA integrates advanced techniques in image processing, segmentation, and 3D reconstruction to efficiently create realistic and detailed interior designs from real-world environments. The design of this integration ensures optimal performance and precision, addressing key challenges in automated indoor design generation by uniquely combining and leveraging the strengths of foundation models. We demonstrate the effectiveness of our approach through experiments, both on self-captured data and public datasets, showcasing its potential to enhance virtual reality (VR) applications by providing interior designs that conform to real-world positioning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_11033 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AURORA: Automated Unleash of 3D Room Outlines for VR Applications Han, Huijun Liang, Yongqing Zhou, Yuanlong Wang, Wenping Rojas-Munoz, Edgar J. Li, Xin Computer Vision and Pattern Recognition 68U07 J.6 Creating realistic VR experiences is challenging due to the labor-intensive process of accurately replicating real-world details into virtual scenes, highlighting the need for automated methods that maintain spatial accuracy and provide design flexibility. In this paper, we propose AURORA, a novel method that leverages RGB-D images to automatically generate both purely virtual reality (VR) scenes and VR scenes combined with real-world elements. This approach can benefit designers by streamlining the process of converting real-world details into virtual scenes. AURORA integrates advanced techniques in image processing, segmentation, and 3D reconstruction to efficiently create realistic and detailed interior designs from real-world environments. The design of this integration ensures optimal performance and precision, addressing key challenges in automated indoor design generation by uniquely combining and leveraging the strengths of foundation models. We demonstrate the effectiveness of our approach through experiments, both on self-captured data and public datasets, showcasing its potential to enhance virtual reality (VR) applications by providing interior designs that conform to real-world positioning. |
| title | AURORA: Automated Unleash of 3D Room Outlines for VR Applications |
| topic | Computer Vision and Pattern Recognition 68U07 J.6 |
| url | https://arxiv.org/abs/2412.11033 |