VR-Doh: Hands-on 3D Modeling in Virtual Reality

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Luo, Zhaofeng, Cui, Zhitong, Luo, Shijian, Chu, Mengyu, Li, Minchen
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912445412409344
author Luo, Zhaofeng
Cui, Zhitong
Luo, Shijian
Chu, Mengyu
Li, Minchen
author_facet Luo, Zhaofeng
Cui, Zhitong
Luo, Shijian
Chu, Mengyu
Li, Minchen
contents We introduce VR-Doh, an open-source, hands-on 3D modeling system that enables intuitive creation and manipulation of elastoplastic objects in Virtual Reality (VR). By customizing the Material Point Method (MPM) for real-time simulation of hand-induced large deformations and enhancing 3D Gaussian Splatting for seamless rendering, VR-Doh provides an interactive and immersive 3D modeling experience. Users can naturally sculpt, deform, and edit objects through both contact- and gesture-based hand-object interactions. To achieve real-time performance, our system incorporates localized simulation techniques, particle-level collision handling, and the decoupling of physical and appearance representations, ensuring smooth and responsive interactions. VR-Doh supports both object creation and editing, enabling diverse modeling tasks such as designing food items, characters, and interlocking structures, all resulting in simulation-ready assets. User studies with both novice and experienced participants highlight the system's intuitive design, immersive feedback, and creative potential. Compared to existing geometric modeling tools, VR-Doh offers enhanced accessibility and natural interaction, making it a powerful tool for creative exploration in VR.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00814
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle VR-Doh: Hands-on 3D Modeling in Virtual Reality
Luo, Zhaofeng
Cui, Zhitong
Luo, Shijian
Chu, Mengyu
Li, Minchen
Graphics
Human-Computer Interaction
We introduce VR-Doh, an open-source, hands-on 3D modeling system that enables intuitive creation and manipulation of elastoplastic objects in Virtual Reality (VR). By customizing the Material Point Method (MPM) for real-time simulation of hand-induced large deformations and enhancing 3D Gaussian Splatting for seamless rendering, VR-Doh provides an interactive and immersive 3D modeling experience. Users can naturally sculpt, deform, and edit objects through both contact- and gesture-based hand-object interactions. To achieve real-time performance, our system incorporates localized simulation techniques, particle-level collision handling, and the decoupling of physical and appearance representations, ensuring smooth and responsive interactions. VR-Doh supports both object creation and editing, enabling diverse modeling tasks such as designing food items, characters, and interlocking structures, all resulting in simulation-ready assets. User studies with both novice and experienced participants highlight the system's intuitive design, immersive feedback, and creative potential. Compared to existing geometric modeling tools, VR-Doh offers enhanced accessibility and natural interaction, making it a powerful tool for creative exploration in VR.
title VR-Doh: Hands-on 3D Modeling in Virtual Reality
topic Graphics
Human-Computer Interaction
url https://arxiv.org/abs/2412.00814