Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917725921607680 |
|---|---|
| author | Martirosyan, Emin Cao, Ming |
| author_facet | Martirosyan, Emin Cao, Ming |
| contents | In this paper, we address the inverse problem in the case of linear-quadratic discrete-time dynamic non-cooperative games. Given feedback laws of players that are known to be a Nash equilibrium pair for a discrete-time linear system, we want find cost function parameters for which the observed feedback laws are optimal and stabilizing. Using the given feedback laws, we introduce a model-based algorithm that generates cost function parameters solving the problem. We provide theoretical results that guarantee the convergence and stability of the algorithm as well as the way to generate new games with necessary properties without requiring to run the complete algorithm repeatedly . Then the algorithm is extended to a model-free version that uses data samples generated by unknown dynamics and has the same properties as the model-based version. Simulation results validate the effectiveness of the proposed algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_03044 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games Martirosyan, Emin Cao, Ming Optimization and Control Dynamical Systems In this paper, we address the inverse problem in the case of linear-quadratic discrete-time dynamic non-cooperative games. Given feedback laws of players that are known to be a Nash equilibrium pair for a discrete-time linear system, we want find cost function parameters for which the observed feedback laws are optimal and stabilizing. Using the given feedback laws, we introduce a model-based algorithm that generates cost function parameters solving the problem. We provide theoretical results that guarantee the convergence and stability of the algorithm as well as the way to generate new games with necessary properties without requiring to run the complete algorithm repeatedly . Then the algorithm is extended to a model-free version that uses data samples generated by unknown dynamics and has the same properties as the model-based version. Simulation results validate the effectiveness of the proposed algorithms. |
| title | Reinforcement Learning for Inverse Linear-quadratic Dynamic Non-cooperative Games |
| topic | Optimization and Control Dynamical Systems |
| url | https://arxiv.org/abs/2311.03044 |