PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Haitian, Yao, Yuan, Yu, Yongsheng, Zhou, Yuqian, Luo, Jiebo, Lin, Zhe
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918229649129472
author Zheng, Haitian
Yao, Yuan
Yu, Yongsheng
Zhou, Yuqian
Luo, Jiebo
Lin, Zhe
author_facet Zheng, Haitian
Yao, Yuan
Yu, Yongsheng
Zhou, Yuqian
Luo, Jiebo
Lin, Zhe
contents Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches, and visible seams along editing boundaries. Existing remedies, including background-conditioned latent decoding and pixel-space harmonization, usually fail to fully eliminate these artifacts in practice and do not generalize well across different latent representations or tasks. We introduce PixPerfect, a pixel-level refinement framework that delivers seamless, high-fidelity local edits across diverse LDM architectures and tasks. PixPerfect leverages (i) a differentiable discriminative pixel space that amplifies and suppresses subtle color and texture discrepancies, (ii) a comprehensive artifact simulation pipeline that exposes the refiner to realistic local editing artifacts during training, and (iii) a direct pixel-space refinement scheme that ensures broad applicability across diverse latent representations and tasks. Extensive experiments on inpainting, object removal, and insertion benchmarks demonstrate that PixPerfect substantially enhances perceptual fidelity and downstream editing performance, establishing a new standard for robust and high-fidelity localized image editing.
format Preprint
id arxiv_https___arxiv_org_abs_2512_03247
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement
Zheng, Haitian
Yao, Yuan
Yu, Yongsheng
Zhou, Yuqian
Luo, Jiebo
Lin, Zhe
Computer Vision and Pattern Recognition
Latent Diffusion Models (LDMs) have markedly advanced the quality of image inpainting and local editing. However, the inherent latent compression often introduces pixel-level inconsistencies, such as chromatic shifts, texture mismatches, and visible seams along editing boundaries. Existing remedies, including background-conditioned latent decoding and pixel-space harmonization, usually fail to fully eliminate these artifacts in practice and do not generalize well across different latent representations or tasks. We introduce PixPerfect, a pixel-level refinement framework that delivers seamless, high-fidelity local edits across diverse LDM architectures and tasks. PixPerfect leverages (i) a differentiable discriminative pixel space that amplifies and suppresses subtle color and texture discrepancies, (ii) a comprehensive artifact simulation pipeline that exposes the refiner to realistic local editing artifacts during training, and (iii) a direct pixel-space refinement scheme that ensures broad applicability across diverse latent representations and tasks. Extensive experiments on inpainting, object removal, and insertion benchmarks demonstrate that PixPerfect substantially enhances perceptual fidelity and downstream editing performance, establishing a new standard for robust and high-fidelity localized image editing.
title PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.03247