Guardado en:
Detalles Bibliográficos
Autores principales: Zhu, Wentao, Zhang, Zhining, Ren, Yuwei, Huang, Yin, Xu, Hao, Wang, Yizhou
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2509.21136
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909805969408000
author Zhu, Wentao
Zhang, Zhining
Ren, Yuwei
Huang, Yin
Xu, Hao
Wang, Yizhou
author_facet Zhu, Wentao
Zhang, Zhining
Ren, Yuwei
Huang, Yin
Xu, Hao
Wang, Yizhou
contents Mirror neurons are a class of neurons that activate both when an individual observes an action and when they perform the same action. This mechanism reveals a fundamental interplay between action understanding and embodied execution, suggesting that these two abilities are inherently connected. Nonetheless, existing machine learning methods largely overlook this interplay, treating these abilities as separate tasks. In this study, we provide a unified perspective in modeling them through the lens of representation learning. We first observe that their intermediate representations spontaneously align. Inspired by mirror neurons, we further introduce an approach that explicitly aligns the representations of observed and executed actions. Specifically, we employ two linear layers to map the representations to a shared latent space, where contrastive learning enforces the alignment of corresponding representations, effectively maximizing their mutual information. Experiments demonstrate that this simple approach fosters mutual synergy between the two tasks, effectively improving representation quality and generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21136
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Embodied Representation Alignment with Mirror Neurons
Zhu, Wentao
Zhang, Zhining
Ren, Yuwei
Huang, Yin
Xu, Hao
Wang, Yizhou
Artificial Intelligence
Mirror neurons are a class of neurons that activate both when an individual observes an action and when they perform the same action. This mechanism reveals a fundamental interplay between action understanding and embodied execution, suggesting that these two abilities are inherently connected. Nonetheless, existing machine learning methods largely overlook this interplay, treating these abilities as separate tasks. In this study, we provide a unified perspective in modeling them through the lens of representation learning. We first observe that their intermediate representations spontaneously align. Inspired by mirror neurons, we further introduce an approach that explicitly aligns the representations of observed and executed actions. Specifically, we employ two linear layers to map the representations to a shared latent space, where contrastive learning enforces the alignment of corresponding representations, effectively maximizing their mutual information. Experiments demonstrate that this simple approach fosters mutual synergy between the two tasks, effectively improving representation quality and generalization.
title Embodied Representation Alignment with Mirror Neurons
topic Artificial Intelligence
url https://arxiv.org/abs/2509.21136