CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Xinhong, Zhang, Yimeng, Qian, Qichen, Zhang, Yuanlong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918534219563008
author Xu, Xinhong
Zhang, Yimeng
Qian, Qichen
Zhang, Yuanlong
author_facet Xu, Xinhong
Zhang, Yimeng
Qian, Qichen
Zhang, Yuanlong
contents Recent work suggests that large-scale, multi-animal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain task-specific, limiting transfer across common neuroscience objectives. To address this challenge, we propose \textbf{CalM}, a self-supervised neural foundation model trained solely on neuronal calcium traces and adaptable to multiple downstream tasks, including forecasting and decoding. Our key contribution is a pretraining framework, composed of a high-performance tokenizer mapping single-neuron traces into a shared discrete vocabulary, and a dual-axis autoregressive transformer modeling dependencies along both the neural and the temporal axis. We evaluate CalM on a large-scale, multi-animal, multi-session dataset. On the neural population dynamics forecasting task, CalM achieves competitive performance against strong specialized baselines after pretraining. With a task-specific head, CalM further adapts to the behavior decoding task and achieves superior results compared with supervised decoding models. Moreover, linear analyses of CalM representations reveal interpretable functional structures beyond predictive accuracy. Taken together, we propose a novel and effective self-supervised pretraining paradigm for foundation models based on calcium traces, paving the way for scalable pretraining and broad applications in functional neural analysis. Code is released at https://github.com/TSuXinH/CalM.
format Preprint
id arxiv_https___arxiv_org_abs_2604_04958
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data
Xu, Xinhong
Zhang, Yimeng
Qian, Qichen
Zhang, Yuanlong
Quantitative Methods
Artificial Intelligence
Neurons and Cognition
Recent work suggests that large-scale, multi-animal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain task-specific, limiting transfer across common neuroscience objectives. To address this challenge, we propose \textbf{CalM}, a self-supervised neural foundation model trained solely on neuronal calcium traces and adaptable to multiple downstream tasks, including forecasting and decoding. Our key contribution is a pretraining framework, composed of a high-performance tokenizer mapping single-neuron traces into a shared discrete vocabulary, and a dual-axis autoregressive transformer modeling dependencies along both the neural and the temporal axis. We evaluate CalM on a large-scale, multi-animal, multi-session dataset. On the neural population dynamics forecasting task, CalM achieves competitive performance against strong specialized baselines after pretraining. With a task-specific head, CalM further adapts to the behavior decoding task and achieves superior results compared with supervised decoding models. Moreover, linear analyses of CalM representations reveal interpretable functional structures beyond predictive accuracy. Taken together, we propose a novel and effective self-supervised pretraining paradigm for foundation models based on calcium traces, paving the way for scalable pretraining and broad applications in functional neural analysis. Code is released at https://github.com/TSuXinH/CalM.
title CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data
topic Quantitative Methods
Artificial Intelligence
Neurons and Cognition
url https://arxiv.org/abs/2604.04958