Robust Reinforcement Learning for Shifting Dynamics During Deployment
Fuente:
Zenodo
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Recurso digital |
| Publicado: |
Zenodo
2021
|
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866901274959544320 |
|---|---|
| author | Stanton, Samuel Fakoor, Rasool Mueller, Jonas Wilson, Andrew Gordon Smola, Alex |
| author_facet | Stanton, Samuel Fakoor, Rasool Mueller, Jonas Wilson, Andrew Gordon Smola, Alex |
| contents | <p>While high-return policies can be learned on a wide range of systems through reinforcement learning, actual deployment of the resulting policies is often hindered by their sensitivity to future changes in the environment. Adversarial training has shown some promise in producing policies that retain better performance under environment shifts, but existing approaches only consider robustness to specific kinds of perturbations that must be specified a priori. As possible changes in future dynamics are typically unknown in practice, we instead seek a policy that is robust to a variety of realistic changes only encountered at test-time. Towards this goal, we propose a new adversarial variant of soft actor-critic, which produces policies on Mujoco continuous control tasks that are simultaneously more robust across various environment shifts, such as changes to friction and body mass.</p> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_18933334 |
| institution | Zenodo |
| language | |
| publishDate | 2021 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | Robust Reinforcement Learning for Shifting Dynamics During Deployment Stanton, Samuel Fakoor, Rasool Mueller, Jonas Wilson, Andrew Gordon Smola, Alex <p>While high-return policies can be learned on a wide range of systems through reinforcement learning, actual deployment of the resulting policies is often hindered by their sensitivity to future changes in the environment. Adversarial training has shown some promise in producing policies that retain better performance under environment shifts, but existing approaches only consider robustness to specific kinds of perturbations that must be specified a priori. As possible changes in future dynamics are typically unknown in practice, we instead seek a policy that is robust to a variety of realistic changes only encountered at test-time. Towards this goal, we propose a new adversarial variant of soft actor-critic, which produces policies on Mujoco continuous control tasks that are simultaneously more robust across various environment shifts, such as changes to friction and body mass.</p> |
| title | Robust Reinforcement Learning for Shifting Dynamics During Deployment |
| url | https://doi.org/10.5281/zenodo.18933334 |