Pontryagin-Bellman Differential Dynamic Programming for Low-Thrust Trajectory Optimization with Path Constraints

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sidhoum, Yanis, Oguri, Kenshiro
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917534895177728
author Sidhoum, Yanis
Oguri, Kenshiro
author_facet Sidhoum, Yanis
Oguri, Kenshiro
contents We introduce a new algorithm to solve constrained nonlinear optimal control problem, with an emphasis on low-thrust trajectory in highly nonlinear dynamics. The algorithm, dubbed Pontryagin-Bellman Differential Dynamic Programming (PDDP), is the result of the incorporation of Pontryagin Minimum Principle (PMP) into the Differential Dynamic Programming (DDP) formulation. Unlike traditional indirect methods that rely on first-order shooting techniques to determine the optimal costate, PDDP optimizes the costates using a null-space trust-region method, solving a series of quadratic subproblems derived from first- and second-order sensitivities. Terminal equality constraints are handled via a general augmented Lagrangian method, while state-path constraints are enforced using a quadratic penalty approach. The resulting solution method represents a significant improvement over classical indirect methods, which are known to be ineffective for state-constrained problems. The use of DDP to optimize the costate partially reduces the inherent sensitivities of indirect methods, thereby improving the robustness to poor initial guess. Finally, the incorporation of PMP within the DDP formulation enables the design of long-duration, multi-spiral low-thrust trajectories with fewer optimization variables compared to classical DDP formulations. Although the paper emphasizes the spacecraft low-thrust trajectory optimization problem, the theoretical foundations are general and applicable to any control-affine optimal control problem.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20291
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Pontryagin-Bellman Differential Dynamic Programming for Low-Thrust Trajectory Optimization with Path Constraints
Sidhoum, Yanis
Oguri, Kenshiro
Optimization and Control
Chaotic Dynamics
We introduce a new algorithm to solve constrained nonlinear optimal control problem, with an emphasis on low-thrust trajectory in highly nonlinear dynamics. The algorithm, dubbed Pontryagin-Bellman Differential Dynamic Programming (PDDP), is the result of the incorporation of Pontryagin Minimum Principle (PMP) into the Differential Dynamic Programming (DDP) formulation. Unlike traditional indirect methods that rely on first-order shooting techniques to determine the optimal costate, PDDP optimizes the costates using a null-space trust-region method, solving a series of quadratic subproblems derived from first- and second-order sensitivities. Terminal equality constraints are handled via a general augmented Lagrangian method, while state-path constraints are enforced using a quadratic penalty approach. The resulting solution method represents a significant improvement over classical indirect methods, which are known to be ineffective for state-constrained problems. The use of DDP to optimize the costate partially reduces the inherent sensitivities of indirect methods, thereby improving the robustness to poor initial guess. Finally, the incorporation of PMP within the DDP formulation enables the design of long-duration, multi-spiral low-thrust trajectories with fewer optimization variables compared to classical DDP formulations. Although the paper emphasizes the spacecraft low-thrust trajectory optimization problem, the theoretical foundations are general and applicable to any control-affine optimal control problem.
title Pontryagin-Bellman Differential Dynamic Programming for Low-Thrust Trajectory Optimization with Path Constraints
topic Optimization and Control
Chaotic Dynamics
url https://arxiv.org/abs/2502.20291