Salvato in:
Dettagli Bibliografici
Autori principali: Burger, Ludwig, Kofler, Annalena, Heinrich, Lukas, Gerland, Ulrich
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:https://arxiv.org/abs/2604.02121
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914440244363264
author Burger, Ludwig
Kofler, Annalena
Heinrich, Lukas
Gerland, Ulrich
author_facet Burger, Ludwig
Kofler, Annalena
Heinrich, Lukas
Gerland, Ulrich
contents Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. In deterministic models, parameter inference often relies on gradients, as they can be obtained efficiently through automatic differentiation. However, these tools cannot be directly applied to stochastic simulation algorithms (SSA) such as the Gillespie algorithm, since sampling from a discrete set of reactions introduces non-differentiable operations. In this work, we adopt three gradient estimators from machine learning for the Gillespie SSA: the Gumbel-Softmax Straight-Through (GS-ST) estimator, the Score Function estimator, and the Alternative Path estimator. We compare the properties of all estimators in two representative systems exhibiting relaxation or oscillatory dynamics, where the latter requires gradient estimation of time-dependent objective functions. We find that the GS-ST estimator mostly yields well-behaved gradient estimates, but exhibits diverging variance in challenging parameter regimes, resulting in unsuccessful parameter inference. In these cases, the other estimators provide more robust, lower variance gradients. Our results demonstrate that gradient-based parameter inference can be integrated effectively with the Gillespie SSA, with different estimators offering complementary advantages.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02121
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Gradient estimators for parameter inference in discrete stochastic kinetic models
Burger, Ludwig
Kofler, Annalena
Heinrich, Lukas
Gerland, Ulrich
Computational Physics
Statistical Mechanics
Machine Learning
Biological Physics
Chemical Physics
Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. In deterministic models, parameter inference often relies on gradients, as they can be obtained efficiently through automatic differentiation. However, these tools cannot be directly applied to stochastic simulation algorithms (SSA) such as the Gillespie algorithm, since sampling from a discrete set of reactions introduces non-differentiable operations. In this work, we adopt three gradient estimators from machine learning for the Gillespie SSA: the Gumbel-Softmax Straight-Through (GS-ST) estimator, the Score Function estimator, and the Alternative Path estimator. We compare the properties of all estimators in two representative systems exhibiting relaxation or oscillatory dynamics, where the latter requires gradient estimation of time-dependent objective functions. We find that the GS-ST estimator mostly yields well-behaved gradient estimates, but exhibits diverging variance in challenging parameter regimes, resulting in unsuccessful parameter inference. In these cases, the other estimators provide more robust, lower variance gradients. Our results demonstrate that gradient-based parameter inference can be integrated effectively with the Gillespie SSA, with different estimators offering complementary advantages.
title Gradient estimators for parameter inference in discrete stochastic kinetic models
topic Computational Physics
Statistical Mechanics
Machine Learning
Biological Physics
Chemical Physics
url https://arxiv.org/abs/2604.02121