Adaptive Rational Activations to Boost Deep Reinforcement Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2021
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909138487869440 |
|---|---|
| author | Delfosse, Quentin Schramowski, Patrick Mundt, Martin Molina, Alejandro Kersting, Kristian |
| author_facet | Delfosse, Quentin Schramowski, Patrick Mundt, Martin Molina, Alejandro Kersting, Kristian |
| contents | Latest insights from biology show that intelligence not only emerges from the connections between neurons but that individual neurons shoulder more computational responsibility than previously anticipated. This perspective should be critical in the context of constantly changing distinct reinforcement learning environments, yet current approaches still primarily employ static activation functions. In this work, we motivate why rationals are suitable for adaptable activation functions and why their inclusion into neural networks is crucial. Inspired by recurrence in residual networks, we derive a condition under which rational units are closed under residual connections and formulate a naturally regularised version: the recurrent-rational. We demonstrate that equipping popular algorithms with (recurrent-)rational activations leads to consistent improvements on Atari games, especially turning simple DQN into a solid approach, competitive to DDQN and Rainbow. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2102_09407 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Adaptive Rational Activations to Boost Deep Reinforcement Learning Delfosse, Quentin Schramowski, Patrick Mundt, Martin Molina, Alejandro Kersting, Kristian Machine Learning Latest insights from biology show that intelligence not only emerges from the connections between neurons but that individual neurons shoulder more computational responsibility than previously anticipated. This perspective should be critical in the context of constantly changing distinct reinforcement learning environments, yet current approaches still primarily employ static activation functions. In this work, we motivate why rationals are suitable for adaptable activation functions and why their inclusion into neural networks is crucial. Inspired by recurrence in residual networks, we derive a condition under which rational units are closed under residual connections and formulate a naturally regularised version: the recurrent-rational. We demonstrate that equipping popular algorithms with (recurrent-)rational activations leads to consistent improvements on Atari games, especially turning simple DQN into a solid approach, competitive to DDQN and Rainbow. |
| title | Adaptive Rational Activations to Boost Deep Reinforcement Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2102.09407 |