Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2312.02232 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913298075615232 |
|---|---|
| author | Ma, Caoyuan Liu, Yu-Lun Wang, Zhixiang Liu, Wu Liu, Xinchen Wang, Zheng |
| author_facet | Ma, Caoyuan Liu, Yu-Lun Wang, Zhixiang Liu, Wu Liu, Xinchen Wang, Zheng |
| contents | We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Instead, we reload these approaches by combining explicit and implicit human representations to design both generalized rigid deformation and specific non-rigid deformation. Our key insight is that explicit shape can reduce the sampling points used to fit implicit representation, and frozen blending weights from SMPL constructing a generalized rigid deformation can effectively avoid overfitting and improve pose generalization performance. Our architecture involving both explicit and implicit representation is simple yet effective. Experiments demonstrate our model can synthesize images under arbitrary poses with few-shot input and increase the speed of synthesizing images by 15 times through a reduction in computational complexity without using any existing acceleration modules. Compared to the state-of-the-art HumanNeRF studies, HumanNeRF-SE achieves better performance with fewer learnable parameters and less training time. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_02232 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses Ma, Caoyuan Liu, Yu-Lun Wang, Zhixiang Liu, Wu Liu, Xinchen Wang, Zheng Computer Vision and Pattern Recognition We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Instead, we reload these approaches by combining explicit and implicit human representations to design both generalized rigid deformation and specific non-rigid deformation. Our key insight is that explicit shape can reduce the sampling points used to fit implicit representation, and frozen blending weights from SMPL constructing a generalized rigid deformation can effectively avoid overfitting and improve pose generalization performance. Our architecture involving both explicit and implicit representation is simple yet effective. Experiments demonstrate our model can synthesize images under arbitrary poses with few-shot input and increase the speed of synthesizing images by 15 times through a reduction in computational complexity without using any existing acceleration modules. Compared to the state-of-the-art HumanNeRF studies, HumanNeRF-SE achieves better performance with fewer learnable parameters and less training time. |
| title | HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2312.02232 |