DRAWER: Digital Reconstruction and Articulation With Environment Realism
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909587981991936 |
|---|---|
| author | Xia, Hongchi Su, Entong Memmel, Marius Jain, Arhan Yu, Raymond Mbiziwo-Tiapo, Numfor Farhadi, Ali Gupta, Abhishek Wang, Shenlong Ma, Wei-Chiu |
| author_facet | Xia, Hongchi Su, Entong Memmel, Marius Jain, Arhan Yu, Raymond Mbiziwo-Tiapo, Numfor Farhadi, Ali Gupta, Abhishek Wang, Shenlong Ma, Wei-Chiu |
| contents | Creating virtual digital replicas from real-world data unlocks significant potential across domains like gaming and robotics. In this paper, we present DRAWER, a novel framework that converts a video of a static indoor scene into a photorealistic and interactive digital environment. Our approach centers on two main contributions: (i) a reconstruction module based on a dual scene representation that reconstructs the scene with fine-grained geometric details, and (ii) an articulation module that identifies articulation types and hinge positions, reconstructs simulatable shapes and appearances and integrates them into the scene. The resulting virtual environment is photorealistic, interactive, and runs in real time, with compatibility for game engines and robotic simulation platforms. We demonstrate the potential of DRAWER by using it to automatically create an interactive game in Unreal Engine and to enable real-to-sim-to-real transfer for robotics applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_15278 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DRAWER: Digital Reconstruction and Articulation With Environment Realism Xia, Hongchi Su, Entong Memmel, Marius Jain, Arhan Yu, Raymond Mbiziwo-Tiapo, Numfor Farhadi, Ali Gupta, Abhishek Wang, Shenlong Ma, Wei-Chiu Computer Vision and Pattern Recognition Robotics Creating virtual digital replicas from real-world data unlocks significant potential across domains like gaming and robotics. In this paper, we present DRAWER, a novel framework that converts a video of a static indoor scene into a photorealistic and interactive digital environment. Our approach centers on two main contributions: (i) a reconstruction module based on a dual scene representation that reconstructs the scene with fine-grained geometric details, and (ii) an articulation module that identifies articulation types and hinge positions, reconstructs simulatable shapes and appearances and integrates them into the scene. The resulting virtual environment is photorealistic, interactive, and runs in real time, with compatibility for game engines and robotic simulation platforms. We demonstrate the potential of DRAWER by using it to automatically create an interactive game in Unreal Engine and to enable real-to-sim-to-real transfer for robotics applications. |
| title | DRAWER: Digital Reconstruction and Articulation With Environment Realism |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2504.15278 |