Inpainting the Neural Picture: Inferring Unrecorded Brain Area Dynamics from Multi-Animal Datasets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xia, Ji, Zhang, Yizi, Wang, Shuqi, Allen, Genevera I., Paninski, Liam, Hurwitz, Cole Lincoln, Miller, Kenneth D.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909843743309824
author Xia, Ji
Zhang, Yizi
Wang, Shuqi
Allen, Genevera I.
Paninski, Liam
Hurwitz, Cole Lincoln
Miller, Kenneth D.
author_facet Xia, Ji
Zhang, Yizi
Wang, Shuqi
Allen, Genevera I.
Paninski, Liam
Hurwitz, Cole Lincoln
Miller, Kenneth D.
contents Characterizing interactions between brain areas is a fundamental goal of systems neuroscience. While such analyses are possible when areas are recorded simultaneously, it is rare to observe all combinations of areas of interest within a single animal or recording session. How can we leverage multi-animal datasets to better understand multi-area interactions? Building on recent progress in large-scale, multi-animal models, we introduce NeuroPaint, a masked autoencoding approach for inferring the dynamics of unrecorded brain areas. By training across animals with overlapping subsets of recorded areas, NeuroPaint learns to reconstruct activity in missing areas based on shared structure across individuals. We train and evaluate our approach on synthetic data and two multi-animal, multi-area Neuropixels datasets. Our results demonstrate that models trained across animals with partial observations can successfully in-paint the dynamics of unrecorded areas, enabling multi-area analyses that transcend the limitations of any single experiment.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11924
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Inpainting the Neural Picture: Inferring Unrecorded Brain Area Dynamics from Multi-Animal Datasets
Xia, Ji
Zhang, Yizi
Wang, Shuqi
Allen, Genevera I.
Paninski, Liam
Hurwitz, Cole Lincoln
Miller, Kenneth D.
Neurons and Cognition
Applications
Machine Learning
Characterizing interactions between brain areas is a fundamental goal of systems neuroscience. While such analyses are possible when areas are recorded simultaneously, it is rare to observe all combinations of areas of interest within a single animal or recording session. How can we leverage multi-animal datasets to better understand multi-area interactions? Building on recent progress in large-scale, multi-animal models, we introduce NeuroPaint, a masked autoencoding approach for inferring the dynamics of unrecorded brain areas. By training across animals with overlapping subsets of recorded areas, NeuroPaint learns to reconstruct activity in missing areas based on shared structure across individuals. We train and evaluate our approach on synthetic data and two multi-animal, multi-area Neuropixels datasets. Our results demonstrate that models trained across animals with partial observations can successfully in-paint the dynamics of unrecorded areas, enabling multi-area analyses that transcend the limitations of any single experiment.
title Inpainting the Neural Picture: Inferring Unrecorded Brain Area Dynamics from Multi-Animal Datasets
topic Neurons and Cognition
Applications
Machine Learning
url https://arxiv.org/abs/2510.11924