CompleteMe: Reference-based Human Image Completion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tsai, Yu-Ju, Price, Brian, Liu, Qing, Figueroa, Luis, Pakhomov, Daniil, Ding, Zhihong, Cohen, Scott, Yang, Ming-Hsuan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909596063367168
author Tsai, Yu-Ju
Price, Brian
Liu, Qing
Figueroa, Luis
Pakhomov, Daniil
Ding, Zhihong
Cohen, Scott
Yang, Ming-Hsuan
author_facet Tsai, Yu-Ju
Price, Brian
Liu, Qing
Figueroa, Luis
Pakhomov, Daniil
Ding, Zhihong
Cohen, Scott
Yang, Ming-Hsuan
contents Recent methods for human image completion can reconstruct plausible body shapes but often fail to preserve unique details, such as specific clothing patterns or distinctive accessories, without explicit reference images. Even state-of-the-art reference-based inpainting approaches struggle to accurately capture and integrate fine-grained details from reference images. To address this limitation, we propose CompleteMe, a novel reference-based human image completion framework. CompleteMe employs a dual U-Net architecture combined with a Region-focused Attention (RFA) Block, which explicitly guides the model's attention toward relevant regions in reference images. This approach effectively captures fine details and ensures accurate semantic correspondence, significantly improving the fidelity and consistency of completed images. Additionally, we introduce a challenging benchmark specifically designed for evaluating reference-based human image completion tasks. Extensive experiments demonstrate that our proposed method achieves superior visual quality and semantic consistency compared to existing techniques. Project page: https://liagm.github.io/CompleteMe/
format Preprint
id arxiv_https___arxiv_org_abs_2504_20042
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CompleteMe: Reference-based Human Image Completion
Tsai, Yu-Ju
Price, Brian
Liu, Qing
Figueroa, Luis
Pakhomov, Daniil
Ding, Zhihong
Cohen, Scott
Yang, Ming-Hsuan
Computer Vision and Pattern Recognition
Recent methods for human image completion can reconstruct plausible body shapes but often fail to preserve unique details, such as specific clothing patterns or distinctive accessories, without explicit reference images. Even state-of-the-art reference-based inpainting approaches struggle to accurately capture and integrate fine-grained details from reference images. To address this limitation, we propose CompleteMe, a novel reference-based human image completion framework. CompleteMe employs a dual U-Net architecture combined with a Region-focused Attention (RFA) Block, which explicitly guides the model's attention toward relevant regions in reference images. This approach effectively captures fine details and ensures accurate semantic correspondence, significantly improving the fidelity and consistency of completed images. Additionally, we introduce a challenging benchmark specifically designed for evaluating reference-based human image completion tasks. Extensive experiments demonstrate that our proposed method achieves superior visual quality and semantic consistency compared to existing techniques. Project page: https://liagm.github.io/CompleteMe/
title CompleteMe: Reference-based Human Image Completion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.20042