TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Freund, Guy, Jurgenson, Tom, Sudry, Matan, Karpas, Erez
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911450071564288
author Freund, Guy
Jurgenson, Tom
Sudry, Matan
Karpas, Erez
author_facet Freund, Guy
Jurgenson, Tom
Sudry, Matan
Karpas, Erez
contents Robotic knot-tying represents a fundamental challenge in robotics due to the complex interactions between deformable objects and strict topological constraints. We present TWISTED-RL, a framework that improves upon the previous state-of-the-art in demonstration-free knot-tying (TWISTED), which smartly decomposed a single knot-tying problem into manageable subproblems, each addressed by a specialized agent. Our approach replaces TWISTED's single-step inverse model that was learned via supervised learning with a multi-step Reinforcement Learning policy conditioned on abstract topological actions rather than goal states. This change allows more delicate topological state transitions while avoiding costly and ineffective data collection protocols, thus enabling better generalization across diverse knot configurations. Experimental results demonstrate that TWISTED-RL manages to solve previously unattainable knots of higher complexity, including commonly used knots such as the Figure-8 and the Overhand. Furthermore, the increase in success rates and drop in planning time establishes TWISTED-RL as the new state-of-the-art in robotic knot-tying without human demonstrations.
format Preprint
id arxiv_https___arxiv_org_abs_2602_14526
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations
Freund, Guy
Jurgenson, Tom
Sudry, Matan
Karpas, Erez
Robotics
Artificial Intelligence
Machine Learning
Robotic knot-tying represents a fundamental challenge in robotics due to the complex interactions between deformable objects and strict topological constraints. We present TWISTED-RL, a framework that improves upon the previous state-of-the-art in demonstration-free knot-tying (TWISTED), which smartly decomposed a single knot-tying problem into manageable subproblems, each addressed by a specialized agent. Our approach replaces TWISTED's single-step inverse model that was learned via supervised learning with a multi-step Reinforcement Learning policy conditioned on abstract topological actions rather than goal states. This change allows more delicate topological state transitions while avoiding costly and ineffective data collection protocols, thus enabling better generalization across diverse knot configurations. Experimental results demonstrate that TWISTED-RL manages to solve previously unattainable knots of higher complexity, including commonly used knots such as the Figure-8 and the Overhand. Furthermore, the increase in success rates and drop in planning time establishes TWISTED-RL as the new state-of-the-art in robotic knot-tying without human demonstrations.
title TWISTED-RL: Hierarchical Skilled Agents for Knot-Tying without Human Demonstrations
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2602.14526