PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909841043226624 |
|---|---|
| author | Wang, Huayi Zhang, Wentao Yu, Runyi Huang, Tao Ren, Junli Jia, Feiyu Wang, Zirui Niu, Xiaojie Chen, Xiao Chen, Jiahe Chen, Qifeng Wang, Jingbo Pang, Jiangmiao |
| author_facet | Wang, Huayi Zhang, Wentao Yu, Runyi Huang, Tao Ren, Junli Jia, Feiyu Wang, Zirui Niu, Xiaojie Chen, Xiao Chen, Jiahe Chen, Qifeng Wang, Jingbo Pang, Jiangmiao |
| contents | Deploying humanoid robots to interact with real-world environments--such as carrying objects or sitting on chairs--requires generalizable, lifelike motions and robust scene perception. Although prior approaches have advanced each capability individually, combining them in a unified system is still an ongoing challenge. In this work, we present a physical-world humanoid-scene interaction system, PhysHSI, that enables humanoids to autonomously perform diverse interaction tasks while maintaining natural and lifelike behaviors. PhysHSI comprises a simulation training pipeline and a real-world deployment system. In simulation, we adopt adversarial motion prior-based policy learning to imitate natural humanoid-scene interaction data across diverse scenarios, achieving both generalization and lifelike behaviors. For real-world deployment, we introduce a coarse-to-fine object localization module that combines LiDAR and camera inputs to provide continuous and robust scene perception. We validate PhysHSI on four representative interactive tasks--box carrying, sitting, lying, and standing up--in both simulation and real-world settings, demonstrating consistently high success rates, strong generalization across diverse task goals, and natural motion patterns. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_11072 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System Wang, Huayi Zhang, Wentao Yu, Runyi Huang, Tao Ren, Junli Jia, Feiyu Wang, Zirui Niu, Xiaojie Chen, Xiao Chen, Jiahe Chen, Qifeng Wang, Jingbo Pang, Jiangmiao Robotics Artificial Intelligence Machine Learning Systems and Control Deploying humanoid robots to interact with real-world environments--such as carrying objects or sitting on chairs--requires generalizable, lifelike motions and robust scene perception. Although prior approaches have advanced each capability individually, combining them in a unified system is still an ongoing challenge. In this work, we present a physical-world humanoid-scene interaction system, PhysHSI, that enables humanoids to autonomously perform diverse interaction tasks while maintaining natural and lifelike behaviors. PhysHSI comprises a simulation training pipeline and a real-world deployment system. In simulation, we adopt adversarial motion prior-based policy learning to imitate natural humanoid-scene interaction data across diverse scenarios, achieving both generalization and lifelike behaviors. For real-world deployment, we introduce a coarse-to-fine object localization module that combines LiDAR and camera inputs to provide continuous and robust scene perception. We validate PhysHSI on four representative interactive tasks--box carrying, sitting, lying, and standing up--in both simulation and real-world settings, demonstrating consistently high success rates, strong generalization across diverse task goals, and natural motion patterns. |
| title | PhysHSI: Towards a Real-World Generalizable and Natural Humanoid-Scene Interaction System |
| topic | Robotics Artificial Intelligence Machine Learning Systems and Control |
| url | https://arxiv.org/abs/2510.11072 |