MoDex: Planning High-Dimensional Dexterous Control via Learning Neural Internal Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915281282007040 |
|---|---|
| author | Wu, Tong Li, Shoujie Lyu, Chuqiao Sou, Kit-Wa Chan, Wang-Sing Ding, Wenbo |
| author_facet | Wu, Tong Li, Shoujie Lyu, Chuqiao Sou, Kit-Wa Chan, Wang-Sing Ding, Wenbo |
| contents | Controlling hands in high-dimensional action space has been a longstanding challenge, yet humans naturally perform dexterous tasks with ease. In this paper, we draw inspiration from the concept of internal model exhibited in human behavior and reconsider dexterous hands as learnable systems. Specifically, we introduce MoDex, a framework that includes a couple of neural networks (NNs) capturing the dynamical characteristics of hands and a bidirectional planning approach, which demonstrates both training and planning efficiency. To show the versatility of MoDex, we further integrate it with an external model to manipulate in-hand objects and a large language model (LLM) to generate various gestures in both simulation and real world. Extensive experiments on different dexterous hands address the data efficiency in learning a new task and the transferability between different tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_10983 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MoDex: Planning High-Dimensional Dexterous Control via Learning Neural Internal Models Wu, Tong Li, Shoujie Lyu, Chuqiao Sou, Kit-Wa Chan, Wang-Sing Ding, Wenbo Robotics Controlling hands in high-dimensional action space has been a longstanding challenge, yet humans naturally perform dexterous tasks with ease. In this paper, we draw inspiration from the concept of internal model exhibited in human behavior and reconsider dexterous hands as learnable systems. Specifically, we introduce MoDex, a framework that includes a couple of neural networks (NNs) capturing the dynamical characteristics of hands and a bidirectional planning approach, which demonstrates both training and planning efficiency. To show the versatility of MoDex, we further integrate it with an external model to manipulate in-hand objects and a large language model (LLM) to generate various gestures in both simulation and real world. Extensive experiments on different dexterous hands address the data efficiency in learning a new task and the transferability between different tasks. |
| title | MoDex: Planning High-Dimensional Dexterous Control via Learning Neural Internal Models |
| topic | Robotics |
| url | https://arxiv.org/abs/2409.10983 |