Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2310.11092 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910584859000832 |
|---|---|
| author | Wu, Jun Li, Sicheng Ji, Sihui Yang, Yifei Wang, Yue Xiong, Rong Liao, Yiyi |
| author_facet | Wu, Jun Li, Sicheng Ji, Sihui Yang, Yifei Wang, Yue Xiong, Rong Liao, Yiyi |
| contents | Recovering 3D geometry and textures of individual objects is crucial for many robotics applications, such as manipulation, pose estimation, and autonomous driving. However, decomposing a target object from a complex background is challenging. Most existing approaches rely on costly manual labels to acquire object instance perception. Recent advancements in 2D self-supervised learning offer new prospects for identifying objects of interest, yet leveraging such noisy 2D features for clean decomposition remains difficult. In this paper, we propose a Decomposed Object Reconstruction (DORec) network based on neural implicit representations. Our key idea is to use 2D self-supervised features to create two levels of masks for supervision: a binary mask for foreground regions and a K-cluster mask for semantically similar regions. These complementary masks result in robust decomposition. Experimental results on different datasets show DORec's superiority in segmenting and reconstructing diverse foreground objects from varied backgrounds enabling downstream tasks such as pose estimation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_11092 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | DORec: Decomposed Object Reconstruction and Segmentation Utilizing 2D Self-Supervised Features Wu, Jun Li, Sicheng Ji, Sihui Yang, Yifei Wang, Yue Xiong, Rong Liao, Yiyi Computer Vision and Pattern Recognition Recovering 3D geometry and textures of individual objects is crucial for many robotics applications, such as manipulation, pose estimation, and autonomous driving. However, decomposing a target object from a complex background is challenging. Most existing approaches rely on costly manual labels to acquire object instance perception. Recent advancements in 2D self-supervised learning offer new prospects for identifying objects of interest, yet leveraging such noisy 2D features for clean decomposition remains difficult. In this paper, we propose a Decomposed Object Reconstruction (DORec) network based on neural implicit representations. Our key idea is to use 2D self-supervised features to create two levels of masks for supervision: a binary mask for foreground regions and a K-cluster mask for semantically similar regions. These complementary masks result in robust decomposition. Experimental results on different datasets show DORec's superiority in segmenting and reconstructing diverse foreground objects from varied backgrounds enabling downstream tasks such as pose estimation. |
| title | DORec: Decomposed Object Reconstruction and Segmentation Utilizing 2D Self-Supervised Features |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2310.11092 |