ReBaR: Reference-Based Reasoning for Robust Pose Estimation from Monocular Images

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cheng, Yongkang, Liang, Mingjiang, Ning, Jifeng, Han, Gaoge, Liu, Wei, Huang, Shaoli
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916018803179520
author Cheng, Yongkang
Liang, Mingjiang
Ning, Jifeng
Han, Gaoge
Liu, Wei
Huang, Shaoli
author_facet Cheng, Yongkang
Liang, Mingjiang
Ning, Jifeng
Han, Gaoge
Liu, Wei
Huang, Shaoli
contents R}easoning for Robust Human Pose and Shape Estimation), designed to estimate human body shape and pose from single-view images. ReBaR effectively addresses the challenges of occlusions and depth ambiguity by learning reference features for part regression reasoning. Our approach starts by extracting features from both body and part regions using an attention-guided mechanism. Subsequently, these features are used to encode additional part-body dependencies for individual part regression, with part features serving as queries and the body feature as a reference. This reference-based reasoning allows our network to infer the spatial relationships of occluded parts with the body, utilizing visible parts and body reference information. ReBaR outperforms contemporary methods on three benchmark datasets and still maintains competitive advantages among recent new approaches. Demonstrating significant improvement in handling depth ambiguity and occlusion. These results strongly support the effectiveness of our reference-based framework for estimating human body shape and pose from single-view images.
format Preprint
id arxiv_https___arxiv_org_abs_2303_11675
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle ReBaR: Reference-Based Reasoning for Robust Pose Estimation from Monocular Images
Cheng, Yongkang
Liang, Mingjiang
Ning, Jifeng
Han, Gaoge
Liu, Wei
Huang, Shaoli
Computer Vision and Pattern Recognition
R}easoning for Robust Human Pose and Shape Estimation), designed to estimate human body shape and pose from single-view images. ReBaR effectively addresses the challenges of occlusions and depth ambiguity by learning reference features for part regression reasoning. Our approach starts by extracting features from both body and part regions using an attention-guided mechanism. Subsequently, these features are used to encode additional part-body dependencies for individual part regression, with part features serving as queries and the body feature as a reference. This reference-based reasoning allows our network to infer the spatial relationships of occluded parts with the body, utilizing visible parts and body reference information. ReBaR outperforms contemporary methods on three benchmark datasets and still maintains competitive advantages among recent new approaches. Demonstrating significant improvement in handling depth ambiguity and occlusion. These results strongly support the effectiveness of our reference-based framework for estimating human body shape and pose from single-view images.
title ReBaR: Reference-Based Reasoning for Robust Pose Estimation from Monocular Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.11675