Adaptive Optimal Control of Linear Periodic Systems: An Off-Policy Value Iteration Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2019
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916533483077632 |
|---|---|
| author | Pang, Bo Jiang, Zhong-Ping |
| author_facet | Pang, Bo Jiang, Zhong-Ping |
| contents | This paper studies the infinite-horizon adaptive optimal control of continuous-time linear periodic (CTLP) systems. A novel value iteration (VI) based off-policy ADP algorithm is proposed for a general class of CTLP systems, so that approximate optimal solutions can be obtained directly from the collected data, without the exact knowledge of system dynamics. Under mild conditions, the proofs on uniform convergence of the proposed algorithm to the optimal solutions are given for both the model-based and model-free cases. The VI-based ADP algorithm is able to find suboptimal controllers without assuming the knowledge of an initial stabilizing controller. Application to the optimal control of a triple inverted pendulum subjected to a periodically varying load demonstrates the feasibility and effectiveness of the proposed method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1901_08650 |
| institution | arXiv |
| publishDate | 2019 |
| record_format | arxiv |
| spellingShingle | Adaptive Optimal Control of Linear Periodic Systems: An Off-Policy Value Iteration Approach Pang, Bo Jiang, Zhong-Ping Systems and Control Optimization and Control This paper studies the infinite-horizon adaptive optimal control of continuous-time linear periodic (CTLP) systems. A novel value iteration (VI) based off-policy ADP algorithm is proposed for a general class of CTLP systems, so that approximate optimal solutions can be obtained directly from the collected data, without the exact knowledge of system dynamics. Under mild conditions, the proofs on uniform convergence of the proposed algorithm to the optimal solutions are given for both the model-based and model-free cases. The VI-based ADP algorithm is able to find suboptimal controllers without assuming the knowledge of an initial stabilizing controller. Application to the optimal control of a triple inverted pendulum subjected to a periodically varying load demonstrates the feasibility and effectiveness of the proposed method. |
| title | Adaptive Optimal Control of Linear Periodic Systems: An Off-Policy Value Iteration Approach |
| topic | Systems and Control Optimization and Control |
| url | https://arxiv.org/abs/1901.08650 |