SmartEraser: Remove Anything from Images using Masked-Region Guidance
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908402955845632 |
|---|---|
| author | Jiang, Longtao Wang, Zhendong Bao, Jianmin Zhou, Wengang Chen, Dongdong Shi, Lei Chen, Dong Li, Houqiang |
| author_facet | Jiang, Longtao Wang, Zhendong Bao, Jianmin Zhou, Wengang Chen, Dongdong Shi, Lei Chen, Dong Li, Houqiang |
| contents | Object removal has so far been dominated by the mask-and-inpaint paradigm, where the masked region is excluded from the input, leaving models relying on unmasked areas to inpaint the missing region. However, this approach lacks contextual information for the masked area, often resulting in unstable performance. In this work, we introduce SmartEraser, built with a new removing paradigm called Masked-Region Guidance. This paradigm retains the masked region in the input, using it as guidance for the removal process. It offers several distinct advantages: (a) it guides the model to accurately identify the object to be removed, preventing its regeneration in the output; (b) since the user mask often extends beyond the object itself, it aids in preserving the surrounding context in the final result. Leveraging this new paradigm, we present Syn4Removal, a large-scale object removal dataset, where instance segmentation data is used to copy and paste objects onto images as removal targets, with the original images serving as ground truths. Experimental results demonstrate that SmartEraser significantly outperforms existing methods, achieving superior performance in object removal, especially in complex scenes with intricate compositions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_08279 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SmartEraser: Remove Anything from Images using Masked-Region Guidance Jiang, Longtao Wang, Zhendong Bao, Jianmin Zhou, Wengang Chen, Dongdong Shi, Lei Chen, Dong Li, Houqiang Computer Vision and Pattern Recognition Object removal has so far been dominated by the mask-and-inpaint paradigm, where the masked region is excluded from the input, leaving models relying on unmasked areas to inpaint the missing region. However, this approach lacks contextual information for the masked area, often resulting in unstable performance. In this work, we introduce SmartEraser, built with a new removing paradigm called Masked-Region Guidance. This paradigm retains the masked region in the input, using it as guidance for the removal process. It offers several distinct advantages: (a) it guides the model to accurately identify the object to be removed, preventing its regeneration in the output; (b) since the user mask often extends beyond the object itself, it aids in preserving the surrounding context in the final result. Leveraging this new paradigm, we present Syn4Removal, a large-scale object removal dataset, where instance segmentation data is used to copy and paste objects onto images as removal targets, with the original images serving as ground truths. Experimental results demonstrate that SmartEraser significantly outperforms existing methods, achieving superior performance in object removal, especially in complex scenes with intricate compositions. |
| title | SmartEraser: Remove Anything from Images using Masked-Region Guidance |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2501.08279 |