ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917394729926656 |
|---|---|
| author | Wang, Boyuan Wang, Xiaofeng Li, Yongkang Zhu, Zheng Chang, Yifan Ye, Angen Zhao, Guosheng Ni, Chaojun Huang, Guan Ren, Yijie Duan, Yueqi Wang, Xingang |
| author_facet | Wang, Boyuan Wang, Xiaofeng Li, Yongkang Zhu, Zheng Chang, Yifan Ye, Angen Zhao, Guosheng Ni, Chaojun Huang, Guan Ren, Yijie Duan, Yueqi Wang, Xingang |
| contents | Reconstructing non-rigid objects with physical plausibility remains a significant challenge. Existing approaches leverage differentiable rendering for per-scene optimization, recovering geometry and dynamics but requiring expensive tuning or manual annotation, which limits practicality and generalizability. To address this, we propose ReconPhys, the first feedforward framework that jointly learns physical attribute estimation and 3D Gaussian Splatting reconstruction from a single monocular video. Our method employs a dual-branch architecture trained via a self-supervised strategy, eliminating the need for ground-truth physics labels. Given a video sequence, ReconPhys simultaneously infers geometry, appearance, and physical attributes. Experiments on a large-scale synthetic dataset demonstrate superior performance: our method achieves 21.64 PSNR in future prediction compared to 13.27 by state-of-the-art optimization baselines, while reducing Chamfer Distance from 0.349 to 0.004. Crucially, ReconPhys enables fast inference (<1 second) versus hours required by existing methods, facilitating rapid generation of simulation-ready assets for robotics and graphics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_07882 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video Wang, Boyuan Wang, Xiaofeng Li, Yongkang Zhu, Zheng Chang, Yifan Ye, Angen Zhao, Guosheng Ni, Chaojun Huang, Guan Ren, Yijie Duan, Yueqi Wang, Xingang Computer Vision and Pattern Recognition Reconstructing non-rigid objects with physical plausibility remains a significant challenge. Existing approaches leverage differentiable rendering for per-scene optimization, recovering geometry and dynamics but requiring expensive tuning or manual annotation, which limits practicality and generalizability. To address this, we propose ReconPhys, the first feedforward framework that jointly learns physical attribute estimation and 3D Gaussian Splatting reconstruction from a single monocular video. Our method employs a dual-branch architecture trained via a self-supervised strategy, eliminating the need for ground-truth physics labels. Given a video sequence, ReconPhys simultaneously infers geometry, appearance, and physical attributes. Experiments on a large-scale synthetic dataset demonstrate superior performance: our method achieves 21.64 PSNR in future prediction compared to 13.27 by state-of-the-art optimization baselines, while reducing Chamfer Distance from 0.349 to 0.004. Crucially, ReconPhys enables fast inference (<1 second) versus hours required by existing methods, facilitating rapid generation of simulation-ready assets for robotics and graphics. |
| title | ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2604.07882 |