VIP: Video Inpainting Pipeline for Real World Human Removal
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915226631274496 |
|---|---|
| author | Sun, Huiming Li, Yikang Yang, Kangning Li, Ruineng Xing, Daitao Xie, Yangbo Fu, Lan Zhang, Kaiyu Chen, Ming Ding, Jiaming Geng, Jiang Cai, Jie Meng, Zibo Ho, Chiuman |
| author_facet | Sun, Huiming Li, Yikang Yang, Kangning Li, Ruineng Xing, Daitao Xie, Yangbo Fu, Lan Zhang, Kaiyu Chen, Ming Ding, Jiaming Geng, Jiang Cai, Jie Meng, Zibo Ho, Chiuman |
| contents | Inpainting for real-world human and pedestrian removal in high-resolution video clips presents significant challenges, particularly in achieving high-quality outcomes, ensuring temporal consistency, and managing complex object interactions that involve humans, their belongings, and their shadows. In this paper, we introduce VIP (Video Inpainting Pipeline), a novel promptless video inpainting framework for real-world human removal applications. VIP enhances a state-of-the-art text-to-video model with a motion module and employs a Variational Autoencoder (VAE) for progressive denoising in the latent space. Additionally, we implement an efficient human-and-belongings segmentation for precise mask generation. Sufficient experimental results demonstrate that VIP achieves superior temporal consistency and visual fidelity across diverse real-world scenarios, surpassing state-of-the-art methods on challenging datasets. Our key contributions include the development of the VIP pipeline, a reference frame integration technique, and the Dual-Fusion Latent Segment Refinement method, all of which address the complexities of inpainting in long, high-resolution video sequences. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_03041 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VIP: Video Inpainting Pipeline for Real World Human Removal Sun, Huiming Li, Yikang Yang, Kangning Li, Ruineng Xing, Daitao Xie, Yangbo Fu, Lan Zhang, Kaiyu Chen, Ming Ding, Jiaming Geng, Jiang Cai, Jie Meng, Zibo Ho, Chiuman Computer Vision and Pattern Recognition Inpainting for real-world human and pedestrian removal in high-resolution video clips presents significant challenges, particularly in achieving high-quality outcomes, ensuring temporal consistency, and managing complex object interactions that involve humans, their belongings, and their shadows. In this paper, we introduce VIP (Video Inpainting Pipeline), a novel promptless video inpainting framework for real-world human removal applications. VIP enhances a state-of-the-art text-to-video model with a motion module and employs a Variational Autoencoder (VAE) for progressive denoising in the latent space. Additionally, we implement an efficient human-and-belongings segmentation for precise mask generation. Sufficient experimental results demonstrate that VIP achieves superior temporal consistency and visual fidelity across diverse real-world scenarios, surpassing state-of-the-art methods on challenging datasets. Our key contributions include the development of the VIP pipeline, a reference frame integration technique, and the Dual-Fusion Latent Segment Refinement method, all of which address the complexities of inpainting in long, high-resolution video sequences. |
| title | VIP: Video Inpainting Pipeline for Real World Human Removal |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2504.03041 |