Forager: a lightweight testbed for continual learning with partial observability in RL
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914526097571840 |
|---|---|
| author | Tang, Steven Xiong, Xinze Hakhverdyan, Anna Patterson, Andrew Adkins, Jacob He, Jiamin Elelimy, Esraa Panahi, Parham Mohammad White, Martha White, Adam |
| author_facet | Tang, Steven Xiong, Xinze Hakhverdyan, Anna Patterson, Andrew Adkins, Jacob He, Jiamin Elelimy, Esraa Panahi, Parham Mohammad White, Martha White, Adam |
| contents | In continual reinforcement learning (CRL), good performance requires never-ending learning, acting, and exploration in a big, partially observable world. Most CRL experiments have focused on loss of plasticity -- the inability to keep learning -- in one-off experiments where some unobservable non-stationarity is added to classic fully observable MDPs. Further, these experiments rarely consider the role of partial observability and the importance of CRL agents that use memory or recurrence. One potential reason for this focus on mitigating loss of plasticity without considering partial observability is that many partially-observable CRL environments are prohibitively expensive. In this paper, we introduce Forager, a light-weight partially-observable CRL environment with a constant memory footprint. We provide a set of experiments and sample tasks demonstrating that Forager is challenging for current CRL agents and yet also allows for in-depth study of those agents. We demonstrate that agents exhibit loss of plasticity, proposed mitigations can help, but that most useful is to leverage state construction. We conclude with a variant of Forager that generates an unending stream of new tasks to learn that clearly highlights the limitations of current CRL agents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_01131 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Forager: a lightweight testbed for continual learning with partial observability in RL Tang, Steven Xiong, Xinze Hakhverdyan, Anna Patterson, Andrew Adkins, Jacob He, Jiamin Elelimy, Esraa Panahi, Parham Mohammad White, Martha White, Adam Machine Learning Artificial Intelligence In continual reinforcement learning (CRL), good performance requires never-ending learning, acting, and exploration in a big, partially observable world. Most CRL experiments have focused on loss of plasticity -- the inability to keep learning -- in one-off experiments where some unobservable non-stationarity is added to classic fully observable MDPs. Further, these experiments rarely consider the role of partial observability and the importance of CRL agents that use memory or recurrence. One potential reason for this focus on mitigating loss of plasticity without considering partial observability is that many partially-observable CRL environments are prohibitively expensive. In this paper, we introduce Forager, a light-weight partially-observable CRL environment with a constant memory footprint. We provide a set of experiments and sample tasks demonstrating that Forager is challenging for current CRL agents and yet also allows for in-depth study of those agents. We demonstrate that agents exhibit loss of plasticity, proposed mitigations can help, but that most useful is to leverage state construction. We conclude with a variant of Forager that generates an unending stream of new tasks to learn that clearly highlights the limitations of current CRL agents. |
| title | Forager: a lightweight testbed for continual learning with partial observability in RL |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2605.01131 |