Stable Deep Reinforcement Learning via Isotropic Gaussian Representations
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911527660945408 |
|---|---|
| author | Pasand, Ali Saheb Obando-Ceron, Johan Courville, Aaron Bashivan, Pouya Castro, Pablo Samuel |
| author_facet | Pasand, Ali Saheb Obando-Ceron, Johan Courville, Aaron Bashivan, Pouya Castro, Pablo Samuel |
| contents | Deep reinforcement learning systems often suffer from unstable training dynamics due to non-stationarity, where learning objectives and data distributions evolve over time. We show that under non-stationary targets, isotropic Gaussian embeddings are provably advantageous. In particular, they induce stable tracking of time-varying targets for linear readouts, achieve maximal entropy under a fixed variance budget, and encourage a balanced use of all representational dimensions--all of which enable agents to be more adaptive and stable. Building on this insight, we propose the use of Sketched Isotropic Gaussian Regularization for shaping representations toward an isotropic Gaussian distribution during training. We demonstrate empirically, over a variety of domains, that this simple and computationally inexpensive method improves performance under non-stationarity while reducing representation collapse, neuron dormancy, and training instability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_19373 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Stable Deep Reinforcement Learning via Isotropic Gaussian Representations Pasand, Ali Saheb Obando-Ceron, Johan Courville, Aaron Bashivan, Pouya Castro, Pablo Samuel Machine Learning Artificial Intelligence Deep reinforcement learning systems often suffer from unstable training dynamics due to non-stationarity, where learning objectives and data distributions evolve over time. We show that under non-stationary targets, isotropic Gaussian embeddings are provably advantageous. In particular, they induce stable tracking of time-varying targets for linear readouts, achieve maximal entropy under a fixed variance budget, and encourage a balanced use of all representational dimensions--all of which enable agents to be more adaptive and stable. Building on this insight, we propose the use of Sketched Isotropic Gaussian Regularization for shaping representations toward an isotropic Gaussian distribution during training. We demonstrate empirically, over a variety of domains, that this simple and computationally inexpensive method improves performance under non-stationarity while reducing representation collapse, neuron dormancy, and training instability. |
| title | Stable Deep Reinforcement Learning via Isotropic Gaussian Representations |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2602.19373 |