Embodiment in multimodal large language models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908596578549760 |
|---|---|
| author | Kadambi, Akila Aziz-Zadeh, Lisa Damasio, Antonio Iacoboni, Marco Narayanan, Srini |
| author_facet | Kadambi, Akila Aziz-Zadeh, Lisa Damasio, Antonio Iacoboni, Marco Narayanan, Srini |
| contents | Multimodal Large Language Models (MLLMs) have demonstrated extraordinary progress in bridging textual and visual inputs. However, MLLMs still face challenges in situated physical and social interactions in sensorally rich, multimodal and real-world settings where the embodied experience of the living organism is essential. We posit that next frontiers for MLLM development require incorporating both internal and external embodiment -- modeling not only external interactions with the world, but also internal states and drives. Here, we describe mechanisms of internal and external embodiment in humans and relate these to current advances in MLLMs in early stages of aligning to human representations. Our dual-embodied framework proposes to model interactions between these forms of embodiment in MLLMs to bridge the gap between multimodal data and world experience. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_13845 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Embodiment in multimodal large language models Kadambi, Akila Aziz-Zadeh, Lisa Damasio, Antonio Iacoboni, Marco Narayanan, Srini Neurons and Cognition Multimodal Large Language Models (MLLMs) have demonstrated extraordinary progress in bridging textual and visual inputs. However, MLLMs still face challenges in situated physical and social interactions in sensorally rich, multimodal and real-world settings where the embodied experience of the living organism is essential. We posit that next frontiers for MLLM development require incorporating both internal and external embodiment -- modeling not only external interactions with the world, but also internal states and drives. Here, we describe mechanisms of internal and external embodiment in humans and relate these to current advances in MLLMs in early stages of aligning to human representations. Our dual-embodied framework proposes to model interactions between these forms of embodiment in MLLMs to bridge the gap between multimodal data and world experience. |
| title | Embodiment in multimodal large language models |
| topic | Neurons and Cognition |
| url | https://arxiv.org/abs/2510.13845 |