Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Yuhang, Shi, Jiyuan, Wang, Dewei, Kong, Jipeng, Liu, Yong, Bai, Chenjia, Li, Xuelong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908859086405632
author Lin, Yuhang
Shi, Jiyuan
Wang, Dewei
Kong, Jipeng
Liu, Yong
Bai, Chenjia
Li, Xuelong
author_facet Lin, Yuhang
Shi, Jiyuan
Wang, Dewei
Kong, Jipeng
Liu, Yong
Bai, Chenjia
Li, Xuelong
contents Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. First, we collect box-carrying motions that are suitable for real-world deployment and optimize penetration artifacts through a Signed Distance Field loss. Second, we propose a novel training framework that conditions the policy on a desired root-trajectory while utilizing reference motion exclusively as a reward. This design not only eliminates the need for intricate reward tuning but also establishes root trajectory as a universal interface for high-level planners, enabling simultaneous navigation and loco-manipulation. Furthermore, to ensure operational reliability, we incorporate a persistent object estimation module. By fusing real-time detection with Digital Twin, this module allows the robot to autonomously detect slippage and trigger re-grasping maneuvers. Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2603_01126
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction
Lin, Yuhang
Shi, Jiyuan
Wang, Dewei
Kong, Jipeng
Liu, Yong
Bai, Chenjia
Li, Xuelong
Robotics
Executing reliable Humanoid-Object Interaction (HOI) tasks for humanoid robots is hindered by the lack of generalized control interfaces and robust closed-loop perception mechanisms. In this work, we introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI, a generalizable framework for robust humanoid loco-manipulation. First, we collect box-carrying motions that are suitable for real-world deployment and optimize penetration artifacts through a Signed Distance Field loss. Second, we propose a novel training framework that conditions the policy on a desired root-trajectory while utilizing reference motion exclusively as a reward. This design not only eliminates the need for intricate reward tuning but also establishes root trajectory as a universal interface for high-level planners, enabling simultaneous navigation and loco-manipulation. Furthermore, to ensure operational reliability, we incorporate a persistent object estimation module. By fusing real-time detection with Digital Twin, this module allows the robot to autonomously detect slippage and trigger re-grasping maneuvers. Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness, achieving reliable long-horizon execution in complex real-world scenarios.
title Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction
topic Robotics
url https://arxiv.org/abs/2603.01126