PUGS: Zero-shot Physical Understanding with Gaussian Splatting
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908276524843008 |
|---|---|
| author | Shuai, Yinghao Yu, Ran Chen, Yuantao Jiang, Zijian Song, Xiaowei Wang, Nan Zheng, Jv Ma, Jianzhu Yang, Meng Wang, Zhicheng Ding, Wenbo Zhao, Hao |
| author_facet | Shuai, Yinghao Yu, Ran Chen, Yuantao Jiang, Zijian Song, Xiaowei Wang, Nan Zheng, Jv Ma, Jianzhu Yang, Meng Wang, Zhicheng Ding, Wenbo Zhao, Hao |
| contents | Current robotic systems can understand the categories and poses of objects well. But understanding physical properties like mass, friction, and hardness, in the wild, remains challenging. We propose a new method that reconstructs 3D objects using the Gaussian splatting representation and predicts various physical properties in a zero-shot manner. We propose two techniques during the reconstruction phase: a geometry-aware regularization loss function to improve the shape quality and a region-aware feature contrastive loss function to promote region affinity. Two other new techniques are designed during inference: a feature-based property propagation module and a volume integration module tailored for the Gaussian representation. Our framework is named as zero-shot physical understanding with Gaussian splatting, or PUGS. PUGS achieves new state-of-the-art results on the standard benchmark of ABO-500 mass prediction. We provide extensive quantitative ablations and qualitative visualization to demonstrate the mechanism of our designs. We show the proposed methodology can help address challenging real-world grasping tasks. Our codes, data, and models are available at https://github.com/EverNorif/PUGS |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12231 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PUGS: Zero-shot Physical Understanding with Gaussian Splatting Shuai, Yinghao Yu, Ran Chen, Yuantao Jiang, Zijian Song, Xiaowei Wang, Nan Zheng, Jv Ma, Jianzhu Yang, Meng Wang, Zhicheng Ding, Wenbo Zhao, Hao Computer Vision and Pattern Recognition Current robotic systems can understand the categories and poses of objects well. But understanding physical properties like mass, friction, and hardness, in the wild, remains challenging. We propose a new method that reconstructs 3D objects using the Gaussian splatting representation and predicts various physical properties in a zero-shot manner. We propose two techniques during the reconstruction phase: a geometry-aware regularization loss function to improve the shape quality and a region-aware feature contrastive loss function to promote region affinity. Two other new techniques are designed during inference: a feature-based property propagation module and a volume integration module tailored for the Gaussian representation. Our framework is named as zero-shot physical understanding with Gaussian splatting, or PUGS. PUGS achieves new state-of-the-art results on the standard benchmark of ABO-500 mass prediction. We provide extensive quantitative ablations and qualitative visualization to demonstrate the mechanism of our designs. We show the proposed methodology can help address challenging real-world grasping tasks. Our codes, data, and models are available at https://github.com/EverNorif/PUGS |
| title | PUGS: Zero-shot Physical Understanding with Gaussian Splatting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2502.12231 |