Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911531126489088 |
|---|---|
| author | Xue, Bowen Duan, Zheng-Peng Yan, Qixin Wang, Wenjing Liu, Hao Guo, Chun-Le Li, Chongyi Li, Chen Lyu, Jing |
| author_facet | Xue, Bowen Duan, Zheng-Peng Yan, Qixin Wang, Wenjing Liu, Hao Guo, Chun-Le Li, Chongyi Li, Chen Lyu, Jing |
| contents | Generating high-fidelity human videos that match user-specified identities is important yet challenging in the field of generative AI. Existing methods often rely on an excessive number of training parameters and lack compatibility with other AIGC tools. In this paper, we propose Stand-In, a lightweight and plug-and-play framework for identity preservation in video generation. Specifically, we introduce a conditional image branch into the pre-trained video generation model. Identity control is achieved through restricted self-attentions with conditional position mapping. Thanks to these designs, which greatly preserve the pre-trained prior of the video generation model, our approach is able to outperform other full-parameter training methods in video quality and identity preservation, even with just $\sim$1% additional parameters and only 2000 training pairs. Moreover, our framework can be seamlessly integrated for other tasks, such as subject-driven video generation, pose-referenced video generation, stylization, and face swapping. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_07901 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generation Xue, Bowen Duan, Zheng-Peng Yan, Qixin Wang, Wenjing Liu, Hao Guo, Chun-Le Li, Chongyi Li, Chen Lyu, Jing Computer Vision and Pattern Recognition Generating high-fidelity human videos that match user-specified identities is important yet challenging in the field of generative AI. Existing methods often rely on an excessive number of training parameters and lack compatibility with other AIGC tools. In this paper, we propose Stand-In, a lightweight and plug-and-play framework for identity preservation in video generation. Specifically, we introduce a conditional image branch into the pre-trained video generation model. Identity control is achieved through restricted self-attentions with conditional position mapping. Thanks to these designs, which greatly preserve the pre-trained prior of the video generation model, our approach is able to outperform other full-parameter training methods in video quality and identity preservation, even with just $\sim$1% additional parameters and only 2000 training pairs. Moreover, our framework can be seamlessly integrated for other tasks, such as subject-driven video generation, pose-referenced video generation, stylization, and face swapping. |
| title | Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.07901 |