Fashion Style Editing with Generative Human Prior

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kong, Chaerin, Lee, Seungyong, Im, Soohyeok, Yang, Wonsuk
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911824472965120
author Kong, Chaerin
Lee, Seungyong
Im, Soohyeok
Yang, Wonsuk
author_facet Kong, Chaerin
Lee, Seungyong
Im, Soohyeok
Yang, Wonsuk
contents Image editing has been a long-standing challenge in the research community with its far-reaching impact on numerous applications. Recently, text-driven methods started to deliver promising results in domains like human faces, but their applications to more complex domains have been relatively limited. In this work, we explore the task of fashion style editing, where we aim to manipulate the fashion style of human imagery using text descriptions. Specifically, we leverage a generative human prior and achieve fashion style editing by navigating its learned latent space. We first verify that the existing text-driven editing methods fall short for our problem due to their overly simplified guidance signal, and propose two directions to reinforce the guidance: textual augmentation and visual referencing. Combined with our empirical findings on the latent space structure, our Fashion Style Editing framework (FaSE) successfully projects abstract fashion concepts onto human images and introduces exciting new applications to the field.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01984
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fashion Style Editing with Generative Human Prior
Kong, Chaerin
Lee, Seungyong
Im, Soohyeok
Yang, Wonsuk
Computer Vision and Pattern Recognition
Image editing has been a long-standing challenge in the research community with its far-reaching impact on numerous applications. Recently, text-driven methods started to deliver promising results in domains like human faces, but their applications to more complex domains have been relatively limited. In this work, we explore the task of fashion style editing, where we aim to manipulate the fashion style of human imagery using text descriptions. Specifically, we leverage a generative human prior and achieve fashion style editing by navigating its learned latent space. We first verify that the existing text-driven editing methods fall short for our problem due to their overly simplified guidance signal, and propose two directions to reinforce the guidance: textual augmentation and visual referencing. Combined with our empirical findings on the latent space structure, our Fashion Style Editing framework (FaSE) successfully projects abstract fashion concepts onto human images and introduces exciting new applications to the field.
title Fashion Style Editing with Generative Human Prior
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2404.01984