Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Mullen Jr, James F., Kothandaraman, Divya, Bera, Aniket, Manocha, Dinesh
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914751553994752
author Mullen Jr, James F.
Kothandaraman, Divya
Bera, Aniket
Manocha, Dinesh
author_facet Mullen Jr, James F.
Kothandaraman, Divya
Bera, Aniket
Manocha, Dinesh
contents We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most important meshes in the animation for the interaction with the scene, which we call "keyframes." These keyframes allow us to better optimize the placement of the animation into the scene such that interactions in the animations (standing, laying, sitting, etc.) match the affordances of the scene (e.g., standing on the floor or laying in a bed). We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study. Human raters preferred our PAAK method over the PROX ground truth data 64.6\% of the time. Additionally, in direct comparisons, the raters preferred PAAK over competing methods including 61.5\% compared to POSA.
format Preprint
id arxiv_https___arxiv_org_abs_2209_06314
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes
Mullen Jr, James F.
Kothandaraman, Divya
Bera, Aniket
Manocha, Dinesh
Computer Vision and Pattern Recognition
We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most important meshes in the animation for the interaction with the scene, which we call "keyframes." These keyframes allow us to better optimize the placement of the animation into the scene such that interactions in the animations (standing, laying, sitting, etc.) match the affordances of the scene (e.g., standing on the floor or laying in a bed). We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study. Human raters preferred our PAAK method over the PROX ground truth data 64.6\% of the time. Additionally, in direct comparisons, the raters preferred PAAK over competing methods including 61.5\% compared to POSA.
title Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2209.06314