Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mudrik, Noga, Chen, Yenho, Yezerets, Eva, Rozell, Christopher J., Charles, Adam S.
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909453029212160
author Mudrik, Noga
Chen, Yenho
Yezerets, Eva
Rozell, Christopher J.
Charles, Adam S.
author_facet Mudrik, Noga
Chen, Yenho
Yezerets, Eva
Rozell, Christopher J.
Charles, Adam S.
contents Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approaches are interrelated by considering dynamical systems as representative of flows on a low-dimensional manifold. Building on this concept, we propose a new decomposed dynamical system model that represents complex non-stationary and nonlinear dynamics of time series data as a sparse combination of simpler, more interpretable components. Our model is trained through a dictionary learning procedure, where we leverage recent results in tracking sparse vectors over time. The decomposed nature of the dynamics is more expressive than previous switched approaches for a given number of parameters and enables modeling of overlapping and non-stationary dynamics. In both continuous-time and discrete-time instructional examples we demonstrate that our model can well approximate the original system, learn efficient representations, and capture smooth transitions between dynamical modes, focusing on intuitive low-dimensional non-stationary linear and nonlinear systems. Furthermore, we highlight our model's ability to efficiently capture and demix population dynamics generated from multiple independent subnetworks, a task that is computationally impractical for switched models. Finally, we apply our model to neural "full brain" recordings of C. elegans data, illustrating a diversity of dynamics that is obscured when classified into discrete states.
format Preprint
id arxiv_https___arxiv_org_abs_2206_02972
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics
Mudrik, Noga
Chen, Yenho
Yezerets, Eva
Rozell, Christopher J.
Charles, Adam S.
Machine Learning
Signal Processing
Neurons and Cognition
Applications
Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approaches are interrelated by considering dynamical systems as representative of flows on a low-dimensional manifold. Building on this concept, we propose a new decomposed dynamical system model that represents complex non-stationary and nonlinear dynamics of time series data as a sparse combination of simpler, more interpretable components. Our model is trained through a dictionary learning procedure, where we leverage recent results in tracking sparse vectors over time. The decomposed nature of the dynamics is more expressive than previous switched approaches for a given number of parameters and enables modeling of overlapping and non-stationary dynamics. In both continuous-time and discrete-time instructional examples we demonstrate that our model can well approximate the original system, learn efficient representations, and capture smooth transitions between dynamical modes, focusing on intuitive low-dimensional non-stationary linear and nonlinear systems. Furthermore, we highlight our model's ability to efficiently capture and demix population dynamics generated from multiple independent subnetworks, a task that is computationally impractical for switched models. Finally, we apply our model to neural "full brain" recordings of C. elegans data, illustrating a diversity of dynamics that is obscured when classified into discrete states.
title Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics
topic Machine Learning
Signal Processing
Neurons and Cognition
Applications
url https://arxiv.org/abs/2206.02972