DeFNet: Deconstructed Strategy for Multi-step Fabric Folding Tasks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gu, Ningquan, He, Ruhan, Yu, Lianqing
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929204316078080
author Gu, Ningquan
He, Ruhan
Yu, Lianqing
author_facet Gu, Ningquan
He, Ruhan
Yu, Lianqing
contents Fabric folding through robots is complex and challenging due to the deformability of fabric. Based on deconstruction strategy, we split the complex fabric folding task into three relatively simple sub-tasks, and propose a Deconstructed Fabric Folding Network (DeFNet), including corresponding three modules to solve them. (1) We use the Folding Planning Module (FPM), which is based on Latent Space Roadmap, to infer the most straight folding intermediate states from the start to the goal in latent space. (2) We utilize the flow-based approach, Folding Action Module (FAM), to calculate the action coordinates and execute them to reach the inferred intermediate state. (3) We introduce an Iterative Interactive Module (IIM) for fabric folding tasks, which can iteratively execute the FPM and FAM after every grasp-and-place action until the fabric reaches the goal. Experimentally, We demonstrated our method on multi-step fabric folding tasks against three baselines in simulation. We also apply the method to an existing robotic system and present its performance.
format Preprint
id arxiv_https___arxiv_org_abs_2303_00323
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle DeFNet: Deconstructed Strategy for Multi-step Fabric Folding Tasks
Gu, Ningquan
He, Ruhan
Yu, Lianqing
Robotics
Fabric folding through robots is complex and challenging due to the deformability of fabric. Based on deconstruction strategy, we split the complex fabric folding task into three relatively simple sub-tasks, and propose a Deconstructed Fabric Folding Network (DeFNet), including corresponding three modules to solve them. (1) We use the Folding Planning Module (FPM), which is based on Latent Space Roadmap, to infer the most straight folding intermediate states from the start to the goal in latent space. (2) We utilize the flow-based approach, Folding Action Module (FAM), to calculate the action coordinates and execute them to reach the inferred intermediate state. (3) We introduce an Iterative Interactive Module (IIM) for fabric folding tasks, which can iteratively execute the FPM and FAM after every grasp-and-place action until the fabric reaches the goal. Experimentally, We demonstrated our method on multi-step fabric folding tasks against three baselines in simulation. We also apply the method to an existing robotic system and present its performance.
title DeFNet: Deconstructed Strategy for Multi-step Fabric Folding Tasks
topic Robotics
url https://arxiv.org/abs/2303.00323