Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909503554846720 |
|---|---|
| author | Chen, Shoubin Wu, Zehao Zhang, Kai Li, Chunyu Zhang, Baiyang Ma, Fei Yu, Fei Richard Li, Qingquan |
| author_facet | Chen, Shoubin Wu, Zehao Zhang, Kai Li, Chunyu Zhang, Baiyang Ma, Fei Yu, Fei Richard Li, Qingquan |
| contents | Embodied multimodal large models (EMLMs) have gained significant attention in recent years due to their potential to bridge the gap between perception, cognition, and action in complex, real-world environments. This comprehensive review explores the development of such models, including Large Language Models (LLMs), Large Vision Models (LVMs), and other models, while also examining other emerging architectures. We discuss the evolution of EMLMs, with a focus on embodied perception, navigation, interaction, and simulation. Furthermore, the review provides a detailed analysis of the datasets used for training and evaluating these models, highlighting the importance of diverse, high-quality data for effective learning. The paper also identifies key challenges faced by EMLMs, including issues of scalability, generalization, and real-time decision-making. Finally, we outline future directions, emphasizing the integration of multimodal sensing, reasoning, and action to advance the development of increasingly autonomous systems. By providing an in-depth analysis of state-of-the-art methods and identifying critical gaps, this paper aims to inspire future advancements in EMLMs and their applications across diverse domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_15336 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directions Chen, Shoubin Wu, Zehao Zhang, Kai Li, Chunyu Zhang, Baiyang Ma, Fei Yu, Fei Richard Li, Qingquan Robotics Artificial Intelligence Embodied multimodal large models (EMLMs) have gained significant attention in recent years due to their potential to bridge the gap between perception, cognition, and action in complex, real-world environments. This comprehensive review explores the development of such models, including Large Language Models (LLMs), Large Vision Models (LVMs), and other models, while also examining other emerging architectures. We discuss the evolution of EMLMs, with a focus on embodied perception, navigation, interaction, and simulation. Furthermore, the review provides a detailed analysis of the datasets used for training and evaluating these models, highlighting the importance of diverse, high-quality data for effective learning. The paper also identifies key challenges faced by EMLMs, including issues of scalability, generalization, and real-time decision-making. Finally, we outline future directions, emphasizing the integration of multimodal sensing, reasoning, and action to advance the development of increasingly autonomous systems. By providing an in-depth analysis of state-of-the-art methods and identifying critical gaps, this paper aims to inspire future advancements in EMLMs and their applications across diverse domains. |
| title | Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directions |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2502.15336 |