Grounding Intelligence in Movement

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Segado, Melanie, Parodi, Felipe, Matelsky, Jordan K., Platt, Michael L., Dyer, Eva B., Kording, Konrad P.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912462907899904
author Segado, Melanie
Parodi, Felipe
Matelsky, Jordan K.
Platt, Michael L.
Dyer, Eva B.
Kording, Konrad P.
author_facet Segado, Melanie
Parodi, Felipe
Matelsky, Jordan K.
Platt, Michael L.
Dyer, Eva B.
Kording, Konrad P.
contents Recent advances in machine learning have dramatically improved our ability to model language, vision, and other high-dimensional data, yet they continue to struggle with one of the most fundamental aspects of biological systems: movement. Across neuroscience, medicine, robotics, and ethology, movement is essential for interpreting behavior, predicting intent, and enabling interaction. Despite its core significance in our intelligence, movement is often treated as an afterthought rather than as a rich and structured modality in its own right. This reflects a deeper fragmentation in how movement data is collected and modeled, often constrained by task-specific goals and domain-specific assumptions. But movement is not domain-bound. It reflects shared physical constraints, conserved morphological structures, and purposeful dynamics that cut across species and settings. We argue that movement should be treated as a primary modeling target for AI. It is inherently structured and grounded in embodiment and physics. This structure, often allowing for compact, lower-dimensional representations (e.g., pose), makes it more interpretable and computationally tractable to model than raw, high-dimensional sensory inputs. Developing models that can learn from and generalize across diverse movement data will not only advance core capabilities in generative modeling and control, but also create a shared foundation for understanding behavior across biological and artificial systems. Movement is not just an outcome, it is a window into how intelligent systems engage with the world.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02771
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Grounding Intelligence in Movement
Segado, Melanie
Parodi, Felipe
Matelsky, Jordan K.
Platt, Michael L.
Dyer, Eva B.
Kording, Konrad P.
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Robotics
Recent advances in machine learning have dramatically improved our ability to model language, vision, and other high-dimensional data, yet they continue to struggle with one of the most fundamental aspects of biological systems: movement. Across neuroscience, medicine, robotics, and ethology, movement is essential for interpreting behavior, predicting intent, and enabling interaction. Despite its core significance in our intelligence, movement is often treated as an afterthought rather than as a rich and structured modality in its own right. This reflects a deeper fragmentation in how movement data is collected and modeled, often constrained by task-specific goals and domain-specific assumptions. But movement is not domain-bound. It reflects shared physical constraints, conserved morphological structures, and purposeful dynamics that cut across species and settings. We argue that movement should be treated as a primary modeling target for AI. It is inherently structured and grounded in embodiment and physics. This structure, often allowing for compact, lower-dimensional representations (e.g., pose), makes it more interpretable and computationally tractable to model than raw, high-dimensional sensory inputs. Developing models that can learn from and generalize across diverse movement data will not only advance core capabilities in generative modeling and control, but also create a shared foundation for understanding behavior across biological and artificial systems. Movement is not just an outcome, it is a window into how intelligent systems engage with the world.
title Grounding Intelligence in Movement
topic Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Robotics
url https://arxiv.org/abs/2507.02771