OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915193979666432 |
|---|---|
| author | Yu, Yongsheng Zeng, Ziyun Zheng, Haitian Luo, Jiebo |
| author_facet | Yu, Yongsheng Zeng, Ziyun Zheng, Haitian Luo, Jiebo |
| contents | Diffusion-based generative models have revolutionized object-oriented image editing, yet their deployment in realistic object removal and insertion remains hampered by challenges such as the intricate interplay of physical effects and insufficient paired training data. In this work, we introduce OmniPaint, a unified framework that re-conceptualizes object removal and insertion as interdependent processes rather than isolated tasks. Leveraging a pre-trained diffusion prior along with a progressive training pipeline comprising initial paired sample optimization and subsequent large-scale unpaired refinement via CycleFlow, OmniPaint achieves precise foreground elimination and seamless object insertion while faithfully preserving scene geometry and intrinsic properties. Furthermore, our novel CFD metric offers a robust, reference-free evaluation of context consistency and object hallucination, establishing a new benchmark for high-fidelity image editing. Project page: https://yeates.github.io/OmniPaint-Page/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_08677 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting Yu, Yongsheng Zeng, Ziyun Zheng, Haitian Luo, Jiebo Computer Vision and Pattern Recognition Diffusion-based generative models have revolutionized object-oriented image editing, yet their deployment in realistic object removal and insertion remains hampered by challenges such as the intricate interplay of physical effects and insufficient paired training data. In this work, we introduce OmniPaint, a unified framework that re-conceptualizes object removal and insertion as interdependent processes rather than isolated tasks. Leveraging a pre-trained diffusion prior along with a progressive training pipeline comprising initial paired sample optimization and subsequent large-scale unpaired refinement via CycleFlow, OmniPaint achieves precise foreground elimination and seamless object insertion while faithfully preserving scene geometry and intrinsic properties. Furthermore, our novel CFD metric offers a robust, reference-free evaluation of context consistency and object hallucination, establishing a new benchmark for high-fidelity image editing. Project page: https://yeates.github.io/OmniPaint-Page/ |
| title | OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.08677 |