Gradient-based optimization of exact stochastic kinetic models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Mottes, Francesco, Zhu, Qian-Ze, Brenner, Michael P.
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917315848699904
author Mottes, Francesco
Zhu, Qian-Ze
Brenner, Michael P.
author_facet Mottes, Francesco
Zhu, Qian-Ze
Brenner, Michael P.
contents Stochastic kinetic models describe systems across biology, chemistry, and physics where discrete events and small populations render deterministic approximations inadequate. Parameter inference and inverse design in these systems require optimizing over trajectories generated by the Stochastic Simulation Algorithm, but the discrete reaction events involved are inherently non-differentiable. We present an approach based on straight-through Gumbel-Softmax estimation that maintains exact stochastic simulations in the forward pass while approximating gradients through a continuous relaxation applied only in the backward pass. We demonstrate robust performance on parameter inference in stochastic gene expression, first recovering kinetic rates of telegraph promoter models from both moment statistics and full steady-state distributions across diverse and challenging synthetic parameter regimes, then inferring the kinetic parameters of a four-state promoter model from experimental single-molecule RNA timecourse measurements. We further apply the method to inverse design in stochastic thermodynamics, optimizing non-equilibrium currents in an interacting particle system under kinetic resource constraints and recovering known analytical bounds. The ability to efficiently differentiate through exact stochastic simulations provides a foundation for systematic scalable inference and rational design across the many domains governed by continuous-time Markov dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2601_14183
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Gradient-based optimization of exact stochastic kinetic models
Mottes, Francesco
Zhu, Qian-Ze
Brenner, Michael P.
Computational Physics
Statistical Mechanics
Quantitative Methods
Stochastic kinetic models describe systems across biology, chemistry, and physics where discrete events and small populations render deterministic approximations inadequate. Parameter inference and inverse design in these systems require optimizing over trajectories generated by the Stochastic Simulation Algorithm, but the discrete reaction events involved are inherently non-differentiable. We present an approach based on straight-through Gumbel-Softmax estimation that maintains exact stochastic simulations in the forward pass while approximating gradients through a continuous relaxation applied only in the backward pass. We demonstrate robust performance on parameter inference in stochastic gene expression, first recovering kinetic rates of telegraph promoter models from both moment statistics and full steady-state distributions across diverse and challenging synthetic parameter regimes, then inferring the kinetic parameters of a four-state promoter model from experimental single-molecule RNA timecourse measurements. We further apply the method to inverse design in stochastic thermodynamics, optimizing non-equilibrium currents in an interacting particle system under kinetic resource constraints and recovering known analytical bounds. The ability to efficiently differentiate through exact stochastic simulations provides a foundation for systematic scalable inference and rational design across the many domains governed by continuous-time Markov dynamics.
title Gradient-based optimization of exact stochastic kinetic models
topic Computational Physics
Statistical Mechanics
Quantitative Methods
url https://arxiv.org/abs/2601.14183