Finite-Horizon Discrete-Time Optimal Control for Nonlinear Systems under State and Control Constraints

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lv, Chuanzhi, Li, Hongdan, Zhang, Huanshui
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916657934368768
author Lv, Chuanzhi
Li, Hongdan
Zhang, Huanshui
author_facet Lv, Chuanzhi
Li, Hongdan
Zhang, Huanshui
contents This paper addresses the optimal control problem of finite-horizon discrete-time nonlinear systems under state and control constraints. A novel numerical algorithm based on optimal control theory is proposed to achieve superior computational efficiency, with the novelty lying in establishing a unified framework that integrates all aspects of algorithm design through the solution of forward and backward difference equations (FBDEs). Firstly, the state and control constraints are transformed using an augmented Lagrangian method (ALM), thereby decomposing the original optimal control problem into several optimization subproblems. These subproblems are then reformulated as new optimal control problem, which are solved through the corresponding FBDEs, resulting in an algorithm with superlinear convergence rate. Furthermore, the gradient and Hessian matrix are computed by iteratively solving FBDEs, thereby accelerating the optimization process. The gradient is obtained through the standard Hamiltonian, while the Hessian matrix is derived by constructing a novel Hamiltonian specifically designed for second-order optimization, transforming each row into an iterative solution of a new set of FBDEs. Finally, the effectiveness of the algorithm is validated through simulation results in automatic guided vehicles (AGV) trajectory tracking control.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15794
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Finite-Horizon Discrete-Time Optimal Control for Nonlinear Systems under State and Control Constraints
Lv, Chuanzhi
Li, Hongdan
Zhang, Huanshui
Optimization and Control
This paper addresses the optimal control problem of finite-horizon discrete-time nonlinear systems under state and control constraints. A novel numerical algorithm based on optimal control theory is proposed to achieve superior computational efficiency, with the novelty lying in establishing a unified framework that integrates all aspects of algorithm design through the solution of forward and backward difference equations (FBDEs). Firstly, the state and control constraints are transformed using an augmented Lagrangian method (ALM), thereby decomposing the original optimal control problem into several optimization subproblems. These subproblems are then reformulated as new optimal control problem, which are solved through the corresponding FBDEs, resulting in an algorithm with superlinear convergence rate. Furthermore, the gradient and Hessian matrix are computed by iteratively solving FBDEs, thereby accelerating the optimization process. The gradient is obtained through the standard Hamiltonian, while the Hessian matrix is derived by constructing a novel Hamiltonian specifically designed for second-order optimization, transforming each row into an iterative solution of a new set of FBDEs. Finally, the effectiveness of the algorithm is validated through simulation results in automatic guided vehicles (AGV) trajectory tracking control.
title Finite-Horizon Discrete-Time Optimal Control for Nonlinear Systems under State and Control Constraints
topic Optimization and Control
url https://arxiv.org/abs/2503.15794