Error Propagation in Dynamic Programming: From Stochastic Control to Option Pricing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Della Vecchia, Andrea, Filipović, Damir
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909804951240704
author Della Vecchia, Andrea
Filipović, Damir
author_facet Della Vecchia, Andrea
Filipović, Damir
contents This paper investigates theoretical and methodological foundations for stochastic optimal control (SOC) in discrete time. We start formulating the control problem in a general dynamic programming framework, introducing the mathematical structure needed for a detailed convergence analysis. The associate value function is estimated through a sequence of approximations combining nonparametric regression methods and Monte Carlo subsampling. The regression step is performed within reproducing kernel Hilbert spaces (RKHSs), exploiting the classical KRR algorithm, while Monte Carlo sampling methods are introduced to estimate the continuation value. To assess the accuracy of our value function estimator, we propose a natural error decomposition and rigorously control the resulting error terms at each time step. We then analyze how this error propagates backward in time-from maturity to the initial stage-a relatively underexplored aspect of the SOC literature. Finally, we illustrate how our analysis naturally applies to a key financial application: the pricing of American options.
format Preprint
id arxiv_https___arxiv_org_abs_2509_20239
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Error Propagation in Dynamic Programming: From Stochastic Control to Option Pricing
Della Vecchia, Andrea
Filipović, Damir
Machine Learning
Computational Finance
Pricing of Securities
Applications
This paper investigates theoretical and methodological foundations for stochastic optimal control (SOC) in discrete time. We start formulating the control problem in a general dynamic programming framework, introducing the mathematical structure needed for a detailed convergence analysis. The associate value function is estimated through a sequence of approximations combining nonparametric regression methods and Monte Carlo subsampling. The regression step is performed within reproducing kernel Hilbert spaces (RKHSs), exploiting the classical KRR algorithm, while Monte Carlo sampling methods are introduced to estimate the continuation value. To assess the accuracy of our value function estimator, we propose a natural error decomposition and rigorously control the resulting error terms at each time step. We then analyze how this error propagates backward in time-from maturity to the initial stage-a relatively underexplored aspect of the SOC literature. Finally, we illustrate how our analysis naturally applies to a key financial application: the pricing of American options.
title Error Propagation in Dynamic Programming: From Stochastic Control to Option Pricing
topic Machine Learning
Computational Finance
Pricing of Securities
Applications
url https://arxiv.org/abs/2509.20239