Variational Inference for Lévy Process-Driven SDEs via Neural Tilting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kindap, Yaman, Opper, Manfred, Dupuis, Benjamin, Simsekli, Umut, Birdal, Tolga
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917481132589056
author Kindap, Yaman
Opper, Manfred
Dupuis, Benjamin
Simsekli, Umut
Birdal, Tolga
author_facet Kindap, Yaman
Opper, Manfred
Dupuis, Benjamin
Simsekli, Umut
Birdal, Tolga
contents Modelling extreme events and heavy-tailed phenomena is central to building reliable predictive systems in domains such as finance, climate science, and safety-critical AI. While Lévy processes provide a natural mathematical framework for capturing jumps and heavy tails, Bayesian inference for Lévy-driven stochastic differential equations (SDEs) remains intractable with existing methods: Monte Carlo approaches are rigorous but lack scalability, whereas neural variational inference methods are efficient but rely on Gaussian assumptions that fail to capture discontinuities. We address this tension by introducing a neural exponential tilting framework for variational inference in Lévy-driven SDEs. Our approach constructs a flexible variational family by exponentially reweighting the Lévy measure using neural networks. This parametrization preserves the jump structure of the underlying process while remaining computationally tractable. To enable efficient inference, we develop a quadratic neural parametrization that yields closed-form normalization of the tilted measure, a conditional Gaussian representation for stable processes that facilitates simulation, and symmetry-aware Monte Carlo estimators for scalable optimization. Empirically, we demonstrate that the method accurately captures jump dynamics and yields reliable posterior inference in regimes where Gaussian-based variational approaches fail, on both synthetic and real-world datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2605_10934
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Variational Inference for Lévy Process-Driven SDEs via Neural Tilting
Kindap, Yaman
Opper, Manfred
Dupuis, Benjamin
Simsekli, Umut
Birdal, Tolga
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Robotics
Modelling extreme events and heavy-tailed phenomena is central to building reliable predictive systems in domains such as finance, climate science, and safety-critical AI. While Lévy processes provide a natural mathematical framework for capturing jumps and heavy tails, Bayesian inference for Lévy-driven stochastic differential equations (SDEs) remains intractable with existing methods: Monte Carlo approaches are rigorous but lack scalability, whereas neural variational inference methods are efficient but rely on Gaussian assumptions that fail to capture discontinuities. We address this tension by introducing a neural exponential tilting framework for variational inference in Lévy-driven SDEs. Our approach constructs a flexible variational family by exponentially reweighting the Lévy measure using neural networks. This parametrization preserves the jump structure of the underlying process while remaining computationally tractable. To enable efficient inference, we develop a quadratic neural parametrization that yields closed-form normalization of the tilted measure, a conditional Gaussian representation for stable processes that facilitates simulation, and symmetry-aware Monte Carlo estimators for scalable optimization. Empirically, we demonstrate that the method accurately captures jump dynamics and yields reliable posterior inference in regimes where Gaussian-based variational approaches fail, on both synthetic and real-world datasets.
title Variational Inference for Lévy Process-Driven SDEs via Neural Tilting
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2605.10934