Physically Compatible 3D Object Modeling from a Single Image
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913630672388096 |
|---|---|
| author | Guo, Minghao Wang, Bohan Ma, Pingchuan Zhang, Tianyuan Owens, Crystal Elaine Gan, Chuang Tenenbaum, Joshua B. He, Kaiming Matusik, Wojciech |
| author_facet | Guo, Minghao Wang, Bohan Ma, Pingchuan Zhang, Tianyuan Owens, Crystal Elaine Gan, Chuang Tenenbaum, Joshua B. He, Kaiming Matusik, Wojciech |
| contents | We present a computational framework that transforms single images into 3D physical objects. The visual geometry of a physical object in an image is determined by three orthogonal attributes: mechanical properties, external forces, and rest-shape geometry. Existing single-view 3D reconstruction methods often overlook this underlying composition, presuming rigidity or neglecting external forces. Consequently, the reconstructed objects fail to withstand real-world physical forces, resulting in instability or undesirable deformation -- diverging from their intended designs as depicted in the image. Our optimization framework addresses this by embedding physical compatibility into the reconstruction process. We explicitly decompose the three physical attributes and link them through static equilibrium, which serves as a hard constraint, ensuring that the optimized physical shapes exhibit desired physical behaviors. Evaluations on a dataset collected from Objaverse demonstrate that our framework consistently enhances the physical realism of 3D models over existing methods. The utility of our framework extends to practical applications in dynamic simulations and 3D printing, where adherence to physical compatibility is paramount. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_20510 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Physically Compatible 3D Object Modeling from a Single Image Guo, Minghao Wang, Bohan Ma, Pingchuan Zhang, Tianyuan Owens, Crystal Elaine Gan, Chuang Tenenbaum, Joshua B. He, Kaiming Matusik, Wojciech Computer Vision and Pattern Recognition We present a computational framework that transforms single images into 3D physical objects. The visual geometry of a physical object in an image is determined by three orthogonal attributes: mechanical properties, external forces, and rest-shape geometry. Existing single-view 3D reconstruction methods often overlook this underlying composition, presuming rigidity or neglecting external forces. Consequently, the reconstructed objects fail to withstand real-world physical forces, resulting in instability or undesirable deformation -- diverging from their intended designs as depicted in the image. Our optimization framework addresses this by embedding physical compatibility into the reconstruction process. We explicitly decompose the three physical attributes and link them through static equilibrium, which serves as a hard constraint, ensuring that the optimized physical shapes exhibit desired physical behaviors. Evaluations on a dataset collected from Objaverse demonstrate that our framework consistently enhances the physical realism of 3D models over existing methods. The utility of our framework extends to practical applications in dynamic simulations and 3D printing, where adherence to physical compatibility is paramount. |
| title | Physically Compatible 3D Object Modeling from a Single Image |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.20510 |