Robot Planning and Situation Handling with Active Perception
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910177763000320 |
|---|---|
| author | Oloo, Austine Altaweel, Zainab Hayamizu, Yohei Liu, Peiqi Ding, Yan Amiri, Saeid Yang, Hao Kaminski, Andy Esselink, Chad Paxton, Chris Zhang, Xiaohan Zhang, Shiqi |
| author_facet | Oloo, Austine Altaweel, Zainab Hayamizu, Yohei Liu, Peiqi Ding, Yan Amiri, Saeid Yang, Hao Kaminski, Andy Esselink, Chad Paxton, Chris Zhang, Xiaohan Zhang, Shiqi |
| contents | Current robots are capable of computing plans to accomplish complex tasks. However, real-world environments are inherently open and dynamic, and unforeseen situations frequently arise during plan execution, such as jamming doors and fallen objects on the floor. These situations may result from the robot's own action failures or from external disturbances, such as human activities. Detecting and handling such execution - time situations remains a significant challenge, limiting those robots' ability to achieve long-term autonomy. In this paper, we develop a planning and situation-handling framework, called VAP-TAMP, that enables robots to actively perceive and address unforeseen situations during plan execution. VAP-TAMP leverages action knowledge to strategically prompt vision-language models for active view selection and situation assessment, while constructing and reasoning over scene graphs for integrated task and motion planning. We evaluated VAP-TAMP using service tasks in simulation and on a mobile manipulation platform. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_26988 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Robot Planning and Situation Handling with Active Perception Oloo, Austine Altaweel, Zainab Hayamizu, Yohei Liu, Peiqi Ding, Yan Amiri, Saeid Yang, Hao Kaminski, Andy Esselink, Chad Paxton, Chris Zhang, Xiaohan Zhang, Shiqi Robotics Current robots are capable of computing plans to accomplish complex tasks. However, real-world environments are inherently open and dynamic, and unforeseen situations frequently arise during plan execution, such as jamming doors and fallen objects on the floor. These situations may result from the robot's own action failures or from external disturbances, such as human activities. Detecting and handling such execution - time situations remains a significant challenge, limiting those robots' ability to achieve long-term autonomy. In this paper, we develop a planning and situation-handling framework, called VAP-TAMP, that enables robots to actively perceive and address unforeseen situations during plan execution. VAP-TAMP leverages action knowledge to strategically prompt vision-language models for active view selection and situation assessment, while constructing and reasoning over scene graphs for integrated task and motion planning. We evaluated VAP-TAMP using service tasks in simulation and on a mobile manipulation platform. |
| title | Robot Planning and Situation Handling with Active Perception |
| topic | Robotics |
| url | https://arxiv.org/abs/2604.26988 |