Task Scheduling & Forgetting in Multi-Task Reinforcement Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Speckmann, Marc, Eimer, Theresa
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929740325060608
author Speckmann, Marc
Eimer, Theresa
author_facet Speckmann, Marc
Eimer, Theresa
contents Reinforcement learning (RL) agents can forget tasks they have previously been trained on. There is a rich body of work on such forgetting effects in humans. Therefore we look for commonalities in the forgetting behavior of humans and RL agents across tasks and test the viability of forgetting prevention measures from learning theory in RL. We find that in many cases, RL agents exhibit forgetting curves similar to those of humans. Methods like Leitner or SuperMemo have been shown to be effective at counteracting human forgetting, but we demonstrate they do not transfer as well to RL. We identify a likely cause: asymmetrical learning and retention patterns between tasks that cannot be captured by retention-based or performance-based curriculum strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01941
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Task Scheduling & Forgetting in Multi-Task Reinforcement Learning
Speckmann, Marc
Eimer, Theresa
Machine Learning
Artificial Intelligence
Reinforcement learning (RL) agents can forget tasks they have previously been trained on. There is a rich body of work on such forgetting effects in humans. Therefore we look for commonalities in the forgetting behavior of humans and RL agents across tasks and test the viability of forgetting prevention measures from learning theory in RL. We find that in many cases, RL agents exhibit forgetting curves similar to those of humans. Methods like Leitner or SuperMemo have been shown to be effective at counteracting human forgetting, but we demonstrate they do not transfer as well to RL. We identify a likely cause: asymmetrical learning and retention patterns between tasks that cannot be captured by retention-based or performance-based curriculum strategies.
title Task Scheduling & Forgetting in Multi-Task Reinforcement Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2503.01941