Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dai, Weichen, Huang, Yuxuan, Zhu, Li, Liu, Dongjun, Zhang, Yu, Zhao, Qibin, Cichocki, Andrzej, Babiloni, Fabio, Li, Ke, Qiu, Jianyu, Jia, Gangyong, Kong, Wanzeng, Wu, Qing
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908453040029696
author Dai, Weichen
Huang, Yuxuan
Zhu, Li
Liu, Dongjun
Zhang, Yu
Zhao, Qibin
Cichocki, Andrzej
Babiloni, Fabio
Li, Ke
Qiu, Jianyu
Jia, Gangyong
Kong, Wanzeng
Wu, Qing
author_facet Dai, Weichen
Huang, Yuxuan
Zhu, Li
Liu, Dongjun
Zhang, Yu
Zhao, Qibin
Cichocki, Andrzej
Babiloni, Fabio
Li, Ke
Qiu, Jianyu
Jia, Gangyong
Kong, Wanzeng
Wu, Qing
contents Humans possess a remarkable capacity for spatial cognition, allowing for self-localization even in novel or unfamiliar environments. While hippocampal neurons encoding position and orientation are well documented, the large-scale neural dynamics supporting spatial representation, particularly during naturalistic, passive experience, remain poorly understood. Here, we demonstrate for the first time that non-invasive brain-computer interfaces (BCIs) based on electroencephalography (EEG) can decode spontaneous, fine-grained egocentric 6D pose, comprising three-dimensional position and orientation, during passive viewing of egocentric video. Despite EEG's limited spatial resolution and high signal noise, we find that spatially coherent visual input (i.e., continuous and structured motion) reliably evokes decodable spatial representations, aligning with participants' subjective sense of spatial engagement. Decoding performance further improves when visual input is presented at a frame rate of 100 ms per image, suggesting alignment with intrinsic neural temporal dynamics. Using gradient-based backpropagation through a neural decoding model, we identify distinct EEG channels contributing to position -- and orientation specific -- components, revealing a distributed yet complementary neural encoding scheme. These findings indicate that the brain's spatial systems operate spontaneously and continuously, even under passive conditions, challenging traditional distinctions between active and passive spatial cognition. Our results offer a non-invasive window into the automatic construction of egocentric spatial maps and advance our understanding of how the human mind transforms everyday sensory experience into structured internal representations.
format Preprint
id arxiv_https___arxiv_org_abs_2507_12417
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI
Dai, Weichen
Huang, Yuxuan
Zhu, Li
Liu, Dongjun
Zhang, Yu
Zhao, Qibin
Cichocki, Andrzej
Babiloni, Fabio
Li, Ke
Qiu, Jianyu
Jia, Gangyong
Kong, Wanzeng
Wu, Qing
Neurons and Cognition
Computer Vision and Pattern Recognition
Signal Processing
Humans possess a remarkable capacity for spatial cognition, allowing for self-localization even in novel or unfamiliar environments. While hippocampal neurons encoding position and orientation are well documented, the large-scale neural dynamics supporting spatial representation, particularly during naturalistic, passive experience, remain poorly understood. Here, we demonstrate for the first time that non-invasive brain-computer interfaces (BCIs) based on electroencephalography (EEG) can decode spontaneous, fine-grained egocentric 6D pose, comprising three-dimensional position and orientation, during passive viewing of egocentric video. Despite EEG's limited spatial resolution and high signal noise, we find that spatially coherent visual input (i.e., continuous and structured motion) reliably evokes decodable spatial representations, aligning with participants' subjective sense of spatial engagement. Decoding performance further improves when visual input is presented at a frame rate of 100 ms per image, suggesting alignment with intrinsic neural temporal dynamics. Using gradient-based backpropagation through a neural decoding model, we identify distinct EEG channels contributing to position -- and orientation specific -- components, revealing a distributed yet complementary neural encoding scheme. These findings indicate that the brain's spatial systems operate spontaneously and continuously, even under passive conditions, challenging traditional distinctions between active and passive spatial cognition. Our results offer a non-invasive window into the automatic construction of egocentric spatial maps and advance our understanding of how the human mind transforms everyday sensory experience into structured internal representations.
title Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI
topic Neurons and Cognition
Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2507.12417