Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2408.14873 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913675155079168 |
|---|---|
| author | Lou, Haozhe Liu, Yurong Pan, Yike Geng, Yiran Chen, Jianteng Ma, Wenlong Li, Chenglong Wang, Lin Feng, Hengzhen Shi, Lu Luo, Liyi Shi, Yongliang |
| author_facet | Lou, Haozhe Liu, Yurong Pan, Yike Geng, Yiran Chen, Jianteng Ma, Wenlong Li, Chenglong Wang, Lin Feng, Hengzhen Shi, Lu Luo, Liyi Shi, Yongliang |
| contents | Real2Sim2Real plays a critical role in robotic arm control and reinforcement learning, yet bridging this gap remains a significant challenge due to the complex physical properties of robots and the objects they manipulate. Existing methods lack a comprehensive solution to accurately reconstruct real-world objects with spatial representations and their associated physics attributes.
We propose a Real2Sim pipeline with a hybrid representation model that integrates mesh geometry, 3D Gaussian kernels, and physics attributes to enhance the digital asset representation of robotic arms.
This hybrid representation is implemented through a Gaussian-Mesh-Pixel binding technique, which establishes an isomorphic mapping between mesh vertices and Gaussian models. This enables a fully differentiable rendering pipeline that can be optimized through numerical solvers, achieves high-fidelity rendering via Gaussian Splatting, and facilitates physically plausible simulation of the robotic arm's interaction with its environment using mesh-based methods.
The code,full presentation and datasets will be made publicly available at our website https://robostudioapp.com |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_14873 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robo-GS: A Physics Consistent Spatial-Temporal Model for Robotic Arm with Hybrid Representation Lou, Haozhe Liu, Yurong Pan, Yike Geng, Yiran Chen, Jianteng Ma, Wenlong Li, Chenglong Wang, Lin Feng, Hengzhen Shi, Lu Luo, Liyi Shi, Yongliang Robotics Numerical Analysis Optimization and Control Real2Sim2Real plays a critical role in robotic arm control and reinforcement learning, yet bridging this gap remains a significant challenge due to the complex physical properties of robots and the objects they manipulate. Existing methods lack a comprehensive solution to accurately reconstruct real-world objects with spatial representations and their associated physics attributes. We propose a Real2Sim pipeline with a hybrid representation model that integrates mesh geometry, 3D Gaussian kernels, and physics attributes to enhance the digital asset representation of robotic arms. This hybrid representation is implemented through a Gaussian-Mesh-Pixel binding technique, which establishes an isomorphic mapping between mesh vertices and Gaussian models. This enables a fully differentiable rendering pipeline that can be optimized through numerical solvers, achieves high-fidelity rendering via Gaussian Splatting, and facilitates physically plausible simulation of the robotic arm's interaction with its environment using mesh-based methods. The code,full presentation and datasets will be made publicly available at our website https://robostudioapp.com |
| title | Robo-GS: A Physics Consistent Spatial-Temporal Model for Robotic Arm with Hybrid Representation |
| topic | Robotics Numerical Analysis Optimization and Control |
| url | https://arxiv.org/abs/2408.14873 |