VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917656887558144 |
|---|---|
| author | Jiang, Ying Yu, Chang Xie, Tianyi Li, Xuan Feng, Yutao Wang, Huamin Li, Minchen Lau, Henry Gao, Feng Yang, Yin Jiang, Chenfanfu |
| author_facet | Jiang, Ying Yu, Chang Xie, Tianyi Li, Xuan Feng, Yutao Wang, Huamin Li, Minchen Lau, Henry Gao, Feng Yang, Yin Jiang, Chenfanfu |
| contents | As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and interaction within these virtual spaces are fraught with difficulties. They tend to be not only engineering-intensive but also require extensive expertise, which adds to the frustration and inefficiency in virtual object manipulation. Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction, offering a seamless and intuitive user experience. By developing a physical dynamics-aware interactive Gaussian Splatting in a Virtual Reality setting, and constructing a highly efficient two-level embedding strategy alongside deformable body simulations, VR-GS ensures real-time execution with highly realistic dynamic responses. The components of our Virtual Reality system are designed for high efficiency and effectiveness, starting from detailed scene reconstruction and object segmentation, advancing through multi-view image in-painting, and extending to interactive physics-based editing. The system also incorporates real-time deformation embedding and dynamic shadow casting, ensuring a comprehensive and engaging virtual experience.Our project page is available at: https://yingjiang96.github.io/VR-GS/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_16663 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality Jiang, Ying Yu, Chang Xie, Tianyi Li, Xuan Feng, Yutao Wang, Huamin Li, Minchen Lau, Henry Gao, Feng Yang, Yin Jiang, Chenfanfu Human-Computer Interaction Computer Vision and Pattern Recognition As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and interaction within these virtual spaces are fraught with difficulties. They tend to be not only engineering-intensive but also require extensive expertise, which adds to the frustration and inefficiency in virtual object manipulation. Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction, offering a seamless and intuitive user experience. By developing a physical dynamics-aware interactive Gaussian Splatting in a Virtual Reality setting, and constructing a highly efficient two-level embedding strategy alongside deformable body simulations, VR-GS ensures real-time execution with highly realistic dynamic responses. The components of our Virtual Reality system are designed for high efficiency and effectiveness, starting from detailed scene reconstruction and object segmentation, advancing through multi-view image in-painting, and extending to interactive physics-based editing. The system also incorporates real-time deformation embedding and dynamic shadow casting, ensuring a comprehensive and engaging virtual experience.Our project page is available at: https://yingjiang96.github.io/VR-GS/. |
| title | VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality |
| topic | Human-Computer Interaction Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.16663 |