H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908865883275264 |
|---|---|
| author | Huang, Jinbang Chen, Wenyuan Li, Zhiyuan Pang, Oscar Hu, Xiao Zhang, Lingfeng Hu, Yuanzhao Zhang, Zhanguang Coates, Mark Cao, Tongtong Quan, Xingyue Zhang, Yingxue |
| author_facet | Huang, Jinbang Chen, Wenyuan Li, Zhiyuan Pang, Oscar Hu, Xiao Zhang, Lingfeng Hu, Yuanzhao Zhang, Zhanguang Coates, Mark Cao, Tongtong Quan, Xingyue Zhang, Yingxue |
| contents | World models are becoming central to robotic planning and control as they enable prediction of future state transitions. Existing approaches often emphasize video generation or natural-language prediction, which are difficult to ground in robot actions and suffer from compounding errors over long horizons. Classic task and motion planning models world transitions in logical space, enabling robot-executable and robust long-horizon reasoning. However, they typically operate independently of visual perception, preventing synchronized symbolic and visual state prediction. We propose a Hierarchical World Model (H-WM) that jointly predicts logical and visual state transitions within a unified framework. H-WM combines a high-level logical world model with a low-level visual world model, integrating the long-horizon robustness of symbolic reasoning with visual grounding. The hierarchical outputs provide stable intermediate guidance for long-horizon tasks, mitigating error accumulation and enabling robust execution across extended task sequences. Experiments across multiple vision-language-action (VLA) control policies demonstrate the effectiveness and generality of H-WM's guidance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_11291 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model Huang, Jinbang Chen, Wenyuan Li, Zhiyuan Pang, Oscar Hu, Xiao Zhang, Lingfeng Hu, Yuanzhao Zhang, Zhanguang Coates, Mark Cao, Tongtong Quan, Xingyue Zhang, Yingxue Robotics World models are becoming central to robotic planning and control as they enable prediction of future state transitions. Existing approaches often emphasize video generation or natural-language prediction, which are difficult to ground in robot actions and suffer from compounding errors over long horizons. Classic task and motion planning models world transitions in logical space, enabling robot-executable and robust long-horizon reasoning. However, they typically operate independently of visual perception, preventing synchronized symbolic and visual state prediction. We propose a Hierarchical World Model (H-WM) that jointly predicts logical and visual state transitions within a unified framework. H-WM combines a high-level logical world model with a low-level visual world model, integrating the long-horizon robustness of symbolic reasoning with visual grounding. The hierarchical outputs provide stable intermediate guidance for long-horizon tasks, mitigating error accumulation and enabling robust execution across extended task sequences. Experiments across multiple vision-language-action (VLA) control policies demonstrate the effectiveness and generality of H-WM's guidance. |
| title | H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model |
| topic | Robotics |
| url | https://arxiv.org/abs/2602.11291 |