UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sun, Caiyi, Sun, Yujing, Li, Xiangyu, Zheng, Yuhang, Ren, Yiming, Wang, Jiamin, Ma, Yuexin, Yiu, Siu-Ming
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917354240212992
author Sun, Caiyi
Sun, Yujing
Li, Xiangyu
Zheng, Yuhang
Ren, Yiming
Wang, Jiamin
Ma, Yuexin
Yiu, Siu-Ming
author_facet Sun, Caiyi
Sun, Yujing
Li, Xiangyu
Zheng, Yuhang
Ren, Yiming
Wang, Jiamin
Ma, Yuexin
Yiu, Siu-Ming
contents Deepface generation has traditionally followed a task-driven paradigm, where distinct tasks (e.g., face transfer and hair transfer) are addressed by task-specific models. Nevertheless, this single-task setting severely limits model generalization and scalability. A unified model capable of solving multiple deepface generation tasks in a single pass represents a promising and practical direction, yet remains challenging due to data scarcity and cross-task conflicts arising from heterogeneous attribute transformations. To this end, we propose UniBioTransfer, the first unified framework capable of handling both conventional deepface tasks (e.g., face transfer and face reenactment) and shape-varying transformations (e.g., hair transfer and head transfer). Besides, UniBioTransfer naturally generalizes to unseen tasks, like lip, eye, and glasses transfer, with minimal fine-tuning. Generally, UniBioTransfer addresses data insufficiency in multi-task generation through a unified data construction strategy, including a swapping-based corruption mechanism designed for spatially dynamic attributes like hair. It further mitigates cross-task interference via an innovative BioMoE, a mixture-of-experts based model coupled with a novel two-stage training strategy that effectively disentangles task-specific knowledge. Extensive experiments demonstrate the effectiveness, generalization, and scalability of UniBioTransfer, outperforming both existing unified models and task-specific methods across a wide range of deepface generation tasks. Project page is at https://scy639.github.io/UniBioTransfer.github.io/
format Preprint
id arxiv_https___arxiv_org_abs_2603_19637
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer
Sun, Caiyi
Sun, Yujing
Li, Xiangyu
Zheng, Yuhang
Ren, Yiming
Wang, Jiamin
Ma, Yuexin
Yiu, Siu-Ming
Computer Vision and Pattern Recognition
Deepface generation has traditionally followed a task-driven paradigm, where distinct tasks (e.g., face transfer and hair transfer) are addressed by task-specific models. Nevertheless, this single-task setting severely limits model generalization and scalability. A unified model capable of solving multiple deepface generation tasks in a single pass represents a promising and practical direction, yet remains challenging due to data scarcity and cross-task conflicts arising from heterogeneous attribute transformations. To this end, we propose UniBioTransfer, the first unified framework capable of handling both conventional deepface tasks (e.g., face transfer and face reenactment) and shape-varying transformations (e.g., hair transfer and head transfer). Besides, UniBioTransfer naturally generalizes to unseen tasks, like lip, eye, and glasses transfer, with minimal fine-tuning. Generally, UniBioTransfer addresses data insufficiency in multi-task generation through a unified data construction strategy, including a swapping-based corruption mechanism designed for spatially dynamic attributes like hair. It further mitigates cross-task interference via an innovative BioMoE, a mixture-of-experts based model coupled with a novel two-stage training strategy that effectively disentangles task-specific knowledge. Extensive experiments demonstrate the effectiveness, generalization, and scalability of UniBioTransfer, outperforming both existing unified models and task-specific methods across a wide range of deepface generation tasks. Project page is at https://scy639.github.io/UniBioTransfer.github.io/
title UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.19637