Population Transformer: Learning Population-level Representations of Neural Activity
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915217010589696 |
|---|---|
| author | Chau, Geeling Wang, Christopher Talukder, Sabera Subramaniam, Vighnesh Soedarmadji, Saraswati Yue, Yisong Katz, Boris Barbu, Andrei |
| author_facet | Chau, Geeling Wang, Christopher Talukder, Sabera Subramaniam, Vighnesh Soedarmadji, Saraswati Yue, Yisong Katz, Boris Barbu, Andrei |
| contents | We present a self-supervised framework that learns population-level codes for arbitrary ensembles of neural recordings at scale. We address key challenges in scaling models with neural time-series data, namely, sparse and variable electrode distribution across subjects and datasets. The Population Transformer (PopT) stacks on top of pretrained temporal embeddings and enhances downstream decoding by enabling learned aggregation of multiple spatially-sparse data channels. The pretrained PopT lowers the amount of data required for downstream decoding experiments, while increasing accuracy, even on held-out subjects and tasks. Compared to end-to-end methods, this approach is computationally lightweight, while achieving similar or better decoding performance. We further show how our framework is generalizable to multiple time-series embeddings and neural data modalities. Beyond decoding, we interpret the pretrained and fine-tuned PopT models to show how they can be used to extract neuroscience insights from large amounts of data. We release our code as well as a pretrained PopT to enable off-the-shelf improvements in multi-channel intracranial data decoding and interpretability. Code is available at https://github.com/czlwang/PopulationTransformer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03044 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Population Transformer: Learning Population-level Representations of Neural Activity Chau, Geeling Wang, Christopher Talukder, Sabera Subramaniam, Vighnesh Soedarmadji, Saraswati Yue, Yisong Katz, Boris Barbu, Andrei Machine Learning Neurons and Cognition We present a self-supervised framework that learns population-level codes for arbitrary ensembles of neural recordings at scale. We address key challenges in scaling models with neural time-series data, namely, sparse and variable electrode distribution across subjects and datasets. The Population Transformer (PopT) stacks on top of pretrained temporal embeddings and enhances downstream decoding by enabling learned aggregation of multiple spatially-sparse data channels. The pretrained PopT lowers the amount of data required for downstream decoding experiments, while increasing accuracy, even on held-out subjects and tasks. Compared to end-to-end methods, this approach is computationally lightweight, while achieving similar or better decoding performance. We further show how our framework is generalizable to multiple time-series embeddings and neural data modalities. Beyond decoding, we interpret the pretrained and fine-tuned PopT models to show how they can be used to extract neuroscience insights from large amounts of data. We release our code as well as a pretrained PopT to enable off-the-shelf improvements in multi-channel intracranial data decoding and interpretability. Code is available at https://github.com/czlwang/PopulationTransformer. |
| title | Population Transformer: Learning Population-level Representations of Neural Activity |
| topic | Machine Learning Neurons and Cognition |
| url | https://arxiv.org/abs/2406.03044 |