KinScene: Model-Based Mobile Manipulation of Articulated Scenes

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hsu, Cheng-Chun, Abbatematteo, Ben, Jiang, Zhenyu, Zhu, Yuke, Martín-Martín, Roberto, Biswas, Joydeep
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913521697030144
author Hsu, Cheng-Chun
Abbatematteo, Ben
Jiang, Zhenyu
Zhu, Yuke
Martín-Martín, Roberto
Biswas, Joydeep
author_facet Hsu, Cheng-Chun
Abbatematteo, Ben
Jiang, Zhenyu
Zhu, Yuke
Martín-Martín, Roberto
Biswas, Joydeep
contents Sequentially interacting with articulated objects is crucial for a mobile manipulator to operate effectively in everyday environments. To enable long-horizon tasks involving articulated objects, this study explores building scene-level articulation models for indoor scenes through autonomous exploration. While previous research has studied mobile manipulation with articulated objects by considering object kinematic constraints, it primarily focuses on individual-object scenarios and lacks extension to a scene-level context for task-level planning. To manipulate multiple object parts sequentially, the robot needs to reason about the resultant motion of each part and anticipate its impact on future actions. We introduce KinScene, a full-stack approach for long-horizon manipulation tasks with articulated objects. The robot maps the scene, detects and physically interacts with articulated objects, collects observations, and infers the articulation properties. For sequential tasks, the robot plans a feasible series of object interactions based on the inferred articulation model. We demonstrate that our approach repeatably constructs accurate scene-level kinematic and geometric models, enabling long-horizon mobile manipulation in a real-world scene. Code and additional results are available at https://chengchunhsu.github.io/KinScene/
format Preprint
id arxiv_https___arxiv_org_abs_2409_16473
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle KinScene: Model-Based Mobile Manipulation of Articulated Scenes
Hsu, Cheng-Chun
Abbatematteo, Ben
Jiang, Zhenyu
Zhu, Yuke
Martín-Martín, Roberto
Biswas, Joydeep
Robotics
Sequentially interacting with articulated objects is crucial for a mobile manipulator to operate effectively in everyday environments. To enable long-horizon tasks involving articulated objects, this study explores building scene-level articulation models for indoor scenes through autonomous exploration. While previous research has studied mobile manipulation with articulated objects by considering object kinematic constraints, it primarily focuses on individual-object scenarios and lacks extension to a scene-level context for task-level planning. To manipulate multiple object parts sequentially, the robot needs to reason about the resultant motion of each part and anticipate its impact on future actions. We introduce KinScene, a full-stack approach for long-horizon manipulation tasks with articulated objects. The robot maps the scene, detects and physically interacts with articulated objects, collects observations, and infers the articulation properties. For sequential tasks, the robot plans a feasible series of object interactions based on the inferred articulation model. We demonstrate that our approach repeatably constructs accurate scene-level kinematic and geometric models, enabling long-horizon mobile manipulation in a real-world scene. Code and additional results are available at https://chengchunhsu.github.io/KinScene/
title KinScene: Model-Based Mobile Manipulation of Articulated Scenes
topic Robotics
url https://arxiv.org/abs/2409.16473