Differentiable GPU-Parallelized Task and Motion Planning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shen, William, Garrett, Caelan, Kumar, Nishanth, Goyal, Ankit, Hermans, Tucker, Kaelbling, Leslie Pack, Lozano-Pérez, Tomás, Ramos, Fabio
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913811516096512
author Shen, William
Garrett, Caelan
Kumar, Nishanth
Goyal, Ankit
Hermans, Tucker
Kaelbling, Leslie Pack
Lozano-Pérez, Tomás
Ramos, Fabio
author_facet Shen, William
Garrett, Caelan
Kumar, Nishanth
Goyal, Ankit
Hermans, Tucker
Kaelbling, Leslie Pack
Lozano-Pérez, Tomás
Ramos, Fabio
contents Planning long-horizon robot manipulation requires making discrete decisions about which objects to interact with and continuous decisions about how to interact with them. A robot planner must select grasps, placements, and motions that are feasible and safe. This class of problems falls under Task and Motion Planning (TAMP) and poses significant computational challenges in terms of algorithm runtime and solution quality, particularly when the solution space is highly constrained. To address these challenges, we propose a new bilevel TAMP algorithm that leverages GPU parallelism to efficiently explore thousands of candidate continuous solutions simultaneously. Our approach uses GPU parallelism to sample an initial batch of solution seeds for a plan skeleton and to apply differentiable optimization on this batch to satisfy plan constraints and minimize solution cost with respect to soft objectives. We demonstrate that our algorithm can effectively solve highly constrained problems with non-convex constraints in just seconds, substantially outperforming serial TAMP approaches, and validate our approach on multiple real-world robots. Project website and code: https://cutamp.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2411_11833
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Differentiable GPU-Parallelized Task and Motion Planning
Shen, William
Garrett, Caelan
Kumar, Nishanth
Goyal, Ankit
Hermans, Tucker
Kaelbling, Leslie Pack
Lozano-Pérez, Tomás
Ramos, Fabio
Robotics
Planning long-horizon robot manipulation requires making discrete decisions about which objects to interact with and continuous decisions about how to interact with them. A robot planner must select grasps, placements, and motions that are feasible and safe. This class of problems falls under Task and Motion Planning (TAMP) and poses significant computational challenges in terms of algorithm runtime and solution quality, particularly when the solution space is highly constrained. To address these challenges, we propose a new bilevel TAMP algorithm that leverages GPU parallelism to efficiently explore thousands of candidate continuous solutions simultaneously. Our approach uses GPU parallelism to sample an initial batch of solution seeds for a plan skeleton and to apply differentiable optimization on this batch to satisfy plan constraints and minimize solution cost with respect to soft objectives. We demonstrate that our algorithm can effectively solve highly constrained problems with non-convex constraints in just seconds, substantially outperforming serial TAMP approaches, and validate our approach on multiple real-world robots. Project website and code: https://cutamp.github.io
title Differentiable GPU-Parallelized Task and Motion Planning
topic Robotics
url https://arxiv.org/abs/2411.11833