Generative Artificial Intelligence in Robotic Manipulation: A Survey
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909533501128704 |
|---|---|
| author | Zhang, Kun Yun, Peng Cen, Jun Cai, Junhao Zhu, Didi Yuan, Hangjie Zhao, Chao Feng, Tao Wang, Michael Yu Chen, Qifeng Pan, Jia Zhang, Wei Yang, Bo Chen, Hua |
| author_facet | Zhang, Kun Yun, Peng Cen, Jun Cai, Junhao Zhu, Didi Yuan, Hangjie Zhao, Chao Feng, Tao Wang, Michael Yu Chen, Qifeng Pan, Jia Zhang, Wei Yang, Bo Chen, Hua |
| contents | This survey provides a comprehensive review on recent advancements of generative learning models in robotic manipulation, addressing key challenges in the field. Robotic manipulation faces critical bottlenecks, including significant challenges in insufficient data and inefficient data acquisition, long-horizon and complex task planning, and the multi-modality reasoning ability for robust policy learning performance across diverse environments. To tackle these challenges, this survey introduces several generative model paradigms, including Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), diffusion models, probabilistic flow models, and autoregressive models, highlighting their strengths and limitations. The applications of these models are categorized into three hierarchical layers: the Foundation Layer, focusing on data generation and reward generation; the Intermediate Layer, covering language, code, visual, and state generation; and the Policy Layer, emphasizing grasp generation and trajectory generation. Each layer is explored in detail, along with notable works that have advanced the state of the art. Finally, the survey outlines future research directions and challenges, emphasizing the need for improved efficiency in data utilization, better handling of long-horizon tasks, and enhanced generalization across diverse robotic scenarios. All the related resources, including research papers, open-source data, and projects, are collected for the community in https://github.com/GAI4Manipulation/AwesomeGAIManipulation |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_03464 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generative Artificial Intelligence in Robotic Manipulation: A Survey Zhang, Kun Yun, Peng Cen, Jun Cai, Junhao Zhu, Didi Yuan, Hangjie Zhao, Chao Feng, Tao Wang, Michael Yu Chen, Qifeng Pan, Jia Zhang, Wei Yang, Bo Chen, Hua Robotics This survey provides a comprehensive review on recent advancements of generative learning models in robotic manipulation, addressing key challenges in the field. Robotic manipulation faces critical bottlenecks, including significant challenges in insufficient data and inefficient data acquisition, long-horizon and complex task planning, and the multi-modality reasoning ability for robust policy learning performance across diverse environments. To tackle these challenges, this survey introduces several generative model paradigms, including Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), diffusion models, probabilistic flow models, and autoregressive models, highlighting their strengths and limitations. The applications of these models are categorized into three hierarchical layers: the Foundation Layer, focusing on data generation and reward generation; the Intermediate Layer, covering language, code, visual, and state generation; and the Policy Layer, emphasizing grasp generation and trajectory generation. Each layer is explored in detail, along with notable works that have advanced the state of the art. Finally, the survey outlines future research directions and challenges, emphasizing the need for improved efficiency in data utilization, better handling of long-horizon tasks, and enhanced generalization across diverse robotic scenarios. All the related resources, including research papers, open-source data, and projects, are collected for the community in https://github.com/GAI4Manipulation/AwesomeGAIManipulation |
| title | Generative Artificial Intelligence in Robotic Manipulation: A Survey |
| topic | Robotics |
| url | https://arxiv.org/abs/2503.03464 |