Avatar Concept Slider: Controllable Editing of Concepts in 3D Human Avatars

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Foo, Lin Geng, He, Yixuan, Mian, Ajmal Saeed, Rahmani, Hossein, Liu, Jun, Theobalt, Christian
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929758824038400
author Foo, Lin Geng
He, Yixuan
Mian, Ajmal Saeed
Rahmani, Hossein
Liu, Jun
Theobalt, Christian
author_facet Foo, Lin Geng
He, Yixuan
Mian, Ajmal Saeed
Rahmani, Hossein
Liu, Jun
Theobalt, Christian
contents Text-based editing of 3D human avatars to precisely match user requirements is challenging due to the inherent ambiguity and limited expressiveness of natural language. To overcome this, we propose the Avatar Concept Slider (ACS), a 3D avatar editing method that allows precise editing of semantic concepts in human avatars towards a specified intermediate point between two extremes of concepts, akin to moving a knob along a slider track. To achieve this, our ACS has three designs: Firstly, a Concept Sliding Loss based on linear discriminant analysis to pinpoint the concept-specific axes for precise editing. Secondly, an Attribute Preserving Loss based on principal component analysis for improved preservation of avatar identity during editing. We further propose a 3D Gaussian Splatting primitive selection mechanism based on concept-sensitivity, which updates only the primitives that are the most sensitive to our target concept, to improve efficiency. Results demonstrate that our ACS enables controllable 3D avatar editing, without compromising the avatar quality or its identifying attributes.
format Preprint
id arxiv_https___arxiv_org_abs_2408_13995
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Avatar Concept Slider: Controllable Editing of Concepts in 3D Human Avatars
Foo, Lin Geng
He, Yixuan
Mian, Ajmal Saeed
Rahmani, Hossein
Liu, Jun
Theobalt, Christian
Computer Vision and Pattern Recognition
Text-based editing of 3D human avatars to precisely match user requirements is challenging due to the inherent ambiguity and limited expressiveness of natural language. To overcome this, we propose the Avatar Concept Slider (ACS), a 3D avatar editing method that allows precise editing of semantic concepts in human avatars towards a specified intermediate point between two extremes of concepts, akin to moving a knob along a slider track. To achieve this, our ACS has three designs: Firstly, a Concept Sliding Loss based on linear discriminant analysis to pinpoint the concept-specific axes for precise editing. Secondly, an Attribute Preserving Loss based on principal component analysis for improved preservation of avatar identity during editing. We further propose a 3D Gaussian Splatting primitive selection mechanism based on concept-sensitivity, which updates only the primitives that are the most sensitive to our target concept, to improve efficiency. Results demonstrate that our ACS enables controllable 3D avatar editing, without compromising the avatar quality or its identifying attributes.
title Avatar Concept Slider: Controllable Editing of Concepts in 3D Human Avatars
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.13995