Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2310.00808 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913220227235840 |
|---|---|
| author | Li, Xiang Chen, Yinpeng Lin, Chung-Ching Chen, Hao Hu, Kai Singh, Rita Raj, Bhiksha Wang, Lijuan Liu, Zicheng |
| author_facet | Li, Xiang Chen, Yinpeng Lin, Chung-Ching Chen, Hao Hu, Kai Singh, Rita Raj, Bhiksha Wang, Lijuan Liu, Zicheng |
| contents | This paper presents a novel approach to object completion, with the primary goal of reconstructing a complete object from its partially visible components. Our method, named MaskComp, delineates the completion process through iterative stages of generation and segmentation. In each iteration, the object mask is provided as an additional condition to boost image generation, and, in return, the generated images can lead to a more accurate mask by fusing the segmentation of images. We demonstrate that the combination of one generation and one segmentation stage effectively functions as a mask denoiser. Through alternation between the generation and segmentation stages, the partial object mask is progressively refined, providing precise shape guidance and yielding superior object completion results. Our experiments demonstrate the superiority of MaskComp over existing approaches, e.g., ControlNet and Stable Diffusion, establishing it as an effective solution for object completion. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_00808 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Completing Visual Objects via Bridging Generation and Segmentation Li, Xiang Chen, Yinpeng Lin, Chung-Ching Chen, Hao Hu, Kai Singh, Rita Raj, Bhiksha Wang, Lijuan Liu, Zicheng Computer Vision and Pattern Recognition This paper presents a novel approach to object completion, with the primary goal of reconstructing a complete object from its partially visible components. Our method, named MaskComp, delineates the completion process through iterative stages of generation and segmentation. In each iteration, the object mask is provided as an additional condition to boost image generation, and, in return, the generated images can lead to a more accurate mask by fusing the segmentation of images. We demonstrate that the combination of one generation and one segmentation stage effectively functions as a mask denoiser. Through alternation between the generation and segmentation stages, the partial object mask is progressively refined, providing precise shape guidance and yielding superior object completion results. Our experiments demonstrate the superiority of MaskComp over existing approaches, e.g., ControlNet and Stable Diffusion, establishing it as an effective solution for object completion. |
| title | Completing Visual Objects via Bridging Generation and Segmentation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2310.00808 |