Error Analysis of Sampling Algorithms for Approximating Stochastic Optimal Control

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Joshi, Anant A., Taghvaei, Amirhossein, Mehta, Prashant G.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913774739390464
author Joshi, Anant A.
Taghvaei, Amirhossein
Mehta, Prashant G.
author_facet Joshi, Anant A.
Taghvaei, Amirhossein
Mehta, Prashant G.
contents This paper is concerned with the error analysis of two types of sampling algorithms, namely model predictive path integral (MPPI) and an interacting particle system (\IPS) algorithm, that have been proposed in the literature for numerical approximation of the stochastic optimal control. The analysis is presented through the lens of Gibbs variational principle. For an illustrative example of a single-stage stochastic optimal control problem, analytical expressions for approximation error and scaling laws, with respect to the state dimension and sample size, are derived. The analytical results are illustrated with numerical simulations.
format Preprint
id arxiv_https___arxiv_org_abs_2504_02198
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Error Analysis of Sampling Algorithms for Approximating Stochastic Optimal Control
Joshi, Anant A.
Taghvaei, Amirhossein
Mehta, Prashant G.
Systems and Control
Numerical Analysis
Optimization and Control
This paper is concerned with the error analysis of two types of sampling algorithms, namely model predictive path integral (MPPI) and an interacting particle system (\IPS) algorithm, that have been proposed in the literature for numerical approximation of the stochastic optimal control. The analysis is presented through the lens of Gibbs variational principle. For an illustrative example of a single-stage stochastic optimal control problem, analytical expressions for approximation error and scaling laws, with respect to the state dimension and sample size, are derived. The analytical results are illustrated with numerical simulations.
title Error Analysis of Sampling Algorithms for Approximating Stochastic Optimal Control
topic Systems and Control
Numerical Analysis
Optimization and Control
url https://arxiv.org/abs/2504.02198