On the System Theoretic Offline Learning of Continuous-Time LQR with Exogenous Disturbances
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911175268106240 |
|---|---|
| author | Mukherjee, Sayak Hossain, Ramij R. Halappanavar, Mahantesh |
| author_facet | Mukherjee, Sayak Hossain, Ramij R. Halappanavar, Mahantesh |
| contents | We analyze offline designs of linear quadratic regulator (LQR) strategies with uncertain disturbances. First, we consider the scenario where the exogenous variable can be estimated in a controlled environment, and subsequently, consider a more practical and challenging scenario where it is unknown in a stochastic setting. Our approach builds on the fundamental learning-based framework of adaptive dynamic programming (ADP), combined with a Lyapunov-based analytical methodology to design the algorithms and derive sample-based approximations motivated from the Markov decision process (MDP)-based approaches. For the scenario involving non-measurable disturbances, we further establish stability and convergence guarantees for the learned control gains under sample-based approximations. The overall methodology emphasizes simplicity while providing rigorous guarantees. Finally, numerical experiments focus on the intricacies and validations for the design of offline continuous-time LQR with exogenous disturbances. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_16746 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the System Theoretic Offline Learning of Continuous-Time LQR with Exogenous Disturbances Mukherjee, Sayak Hossain, Ramij R. Halappanavar, Mahantesh Systems and Control Machine Learning We analyze offline designs of linear quadratic regulator (LQR) strategies with uncertain disturbances. First, we consider the scenario where the exogenous variable can be estimated in a controlled environment, and subsequently, consider a more practical and challenging scenario where it is unknown in a stochastic setting. Our approach builds on the fundamental learning-based framework of adaptive dynamic programming (ADP), combined with a Lyapunov-based analytical methodology to design the algorithms and derive sample-based approximations motivated from the Markov decision process (MDP)-based approaches. For the scenario involving non-measurable disturbances, we further establish stability and convergence guarantees for the learned control gains under sample-based approximations. The overall methodology emphasizes simplicity while providing rigorous guarantees. Finally, numerical experiments focus on the intricacies and validations for the design of offline continuous-time LQR with exogenous disturbances. |
| title | On the System Theoretic Offline Learning of Continuous-Time LQR with Exogenous Disturbances |
| topic | Systems and Control Machine Learning |
| url | https://arxiv.org/abs/2509.16746 |