ChronoTailor: Harnessing Attention Guidance for Fine-Grained Video Virtual Try-On

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Jinjuan, Sun, Wenzhang, Li, Ming, Zheng, Yun, Li, Fanyao, Tao, Zhulin, Di, Donglin, Li, Hao, Chen, Wei, Huang, Xianglin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910991932981248
author Wang, Jinjuan
Sun, Wenzhang
Li, Ming
Zheng, Yun
Li, Fanyao
Tao, Zhulin
Di, Donglin
Li, Hao
Chen, Wei
Huang, Xianglin
author_facet Wang, Jinjuan
Sun, Wenzhang
Li, Ming
Zheng, Yun
Li, Fanyao
Tao, Zhulin
Di, Donglin
Li, Hao
Chen, Wei
Huang, Xianglin
contents Video virtual try-on aims to seamlessly replace the clothing of a person in a source video with a target garment. Despite significant progress in this field, existing approaches still struggle to maintain continuity and reproduce garment details. In this paper, we introduce ChronoTailor, a diffusion-based framework that generates temporally consistent videos while preserving fine-grained garment details. By employing a precise spatio-temporal attention mechanism to guide the integration of fine-grained garment features, ChronoTailor achieves robust try-on performance. First, ChronoTailor leverages region-aware spatial guidance to steer the evolution of spatial attention and employs an attention-driven temporal feature fusion mechanism to generate more continuous temporal features. This dual approach not only enables fine-grained local editing but also effectively mitigates artifacts arising from video dynamics. Second, ChronoTailor integrates multi-scale garment features to preserve low-level visual details and incorporates a garment-pose feature alignment to ensure temporal continuity during dynamic motion. Additionally, we collect StyleDress, a new dataset featuring intricate garments, varied environments, and diverse poses, offering advantages over existing public datasets, and will be publicly available for research. Extensive experiments show that ChronoTailor maintains spatio-temporal continuity and preserves garment details during motion, significantly outperforming previous methods.
format Preprint
id arxiv_https___arxiv_org_abs_2506_05858
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ChronoTailor: Harnessing Attention Guidance for Fine-Grained Video Virtual Try-On
Wang, Jinjuan
Sun, Wenzhang
Li, Ming
Zheng, Yun
Li, Fanyao
Tao, Zhulin
Di, Donglin
Li, Hao
Chen, Wei
Huang, Xianglin
Computer Vision and Pattern Recognition
Video virtual try-on aims to seamlessly replace the clothing of a person in a source video with a target garment. Despite significant progress in this field, existing approaches still struggle to maintain continuity and reproduce garment details. In this paper, we introduce ChronoTailor, a diffusion-based framework that generates temporally consistent videos while preserving fine-grained garment details. By employing a precise spatio-temporal attention mechanism to guide the integration of fine-grained garment features, ChronoTailor achieves robust try-on performance. First, ChronoTailor leverages region-aware spatial guidance to steer the evolution of spatial attention and employs an attention-driven temporal feature fusion mechanism to generate more continuous temporal features. This dual approach not only enables fine-grained local editing but also effectively mitigates artifacts arising from video dynamics. Second, ChronoTailor integrates multi-scale garment features to preserve low-level visual details and incorporates a garment-pose feature alignment to ensure temporal continuity during dynamic motion. Additionally, we collect StyleDress, a new dataset featuring intricate garments, varied environments, and diverse poses, offering advantages over existing public datasets, and will be publicly available for research. Extensive experiments show that ChronoTailor maintains spatio-temporal continuity and preserves garment details during motion, significantly outperforming previous methods.
title ChronoTailor: Harnessing Attention Guidance for Fine-Grained Video Virtual Try-On
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.05858