Total-Editing: Head Avatar with Editable Appearance, Motion, and Lighting
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915305997991936 |
|---|---|
| author | Zhao, Yizhou Liu, Chunjiang Chen, Haoyu Raj, Bhiksha Xu, Min Baltrusaitis, Tadas Rundle, Mitch Wu, HsiangTao Ghasedi, Kamran |
| author_facet | Zhao, Yizhou Liu, Chunjiang Chen, Haoyu Raj, Bhiksha Xu, Min Baltrusaitis, Tadas Rundle, Mitch Wu, HsiangTao Ghasedi, Kamran |
| contents | Face reenactment and portrait relighting are essential tasks in portrait editing, yet they are typically addressed independently, without much synergy. Most face reenactment methods prioritize motion control and multiview consistency, while portrait relighting focuses on adjusting shading effects. To take advantage of both geometric consistency and illumination awareness, we introduce Total-Editing, a unified portrait editing framework that enables precise control over appearance, motion, and lighting. Specifically, we design a neural radiance field decoder with intrinsic decomposition capabilities. This allows seamless integration of lighting information from portrait images or HDR environment maps into synthesized portraits. We also incorporate a moving least squares based deformation field to enhance the spatiotemporal coherence of avatar motion and shading effects. With these innovations, our unified framework significantly improves the quality and realism of portrait editing results. Further, the multi-source nature of Total-Editing supports more flexible applications, such as illumination transfer from one portrait to another, or portrait animation with customized backgrounds. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_20582 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Total-Editing: Head Avatar with Editable Appearance, Motion, and Lighting Zhao, Yizhou Liu, Chunjiang Chen, Haoyu Raj, Bhiksha Xu, Min Baltrusaitis, Tadas Rundle, Mitch Wu, HsiangTao Ghasedi, Kamran Computer Vision and Pattern Recognition Face reenactment and portrait relighting are essential tasks in portrait editing, yet they are typically addressed independently, without much synergy. Most face reenactment methods prioritize motion control and multiview consistency, while portrait relighting focuses on adjusting shading effects. To take advantage of both geometric consistency and illumination awareness, we introduce Total-Editing, a unified portrait editing framework that enables precise control over appearance, motion, and lighting. Specifically, we design a neural radiance field decoder with intrinsic decomposition capabilities. This allows seamless integration of lighting information from portrait images or HDR environment maps into synthesized portraits. We also incorporate a moving least squares based deformation field to enhance the spatiotemporal coherence of avatar motion and shading effects. With these innovations, our unified framework significantly improves the quality and realism of portrait editing results. Further, the multi-source nature of Total-Editing supports more flexible applications, such as illumination transfer from one portrait to another, or portrait animation with customized backgrounds. |
| title | Total-Editing: Head Avatar with Editable Appearance, Motion, and Lighting |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.20582 |