Saved in:
Bibliographic Details
Main Authors: Malagón, Mikel, Ceberio, Josu, Lozano, Jose A.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.14811
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911010508505088
author Malagón, Mikel
Ceberio, Josu
Lozano, Jose A.
author_facet Malagón, Mikel
Ceberio, Josu
Lozano, Jose A.
contents This work introduces a growable and modular neural network architecture that naturally avoids catastrophic forgetting and interference in continual reinforcement learning. The structure of each module allows the selective combination of previous policies along with its internal policy, accelerating the learning process on the current task. Unlike previous growing neural network approaches, we show that the number of parameters of the proposed approach grows linearly with respect to the number of tasks, and does not sacrifice plasticity to scale. Experiments conducted in benchmark continuous control and visual problems reveal that the proposed approach achieves greater knowledge transfer and performance than alternative methods.
format Preprint
id arxiv_https___arxiv_org_abs_2506_14811
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Composing Policies for Scalable Continual Reinforcement Learning
Malagón, Mikel
Ceberio, Josu
Lozano, Jose A.
Machine Learning
This work introduces a growable and modular neural network architecture that naturally avoids catastrophic forgetting and interference in continual reinforcement learning. The structure of each module allows the selective combination of previous policies along with its internal policy, accelerating the learning process on the current task. Unlike previous growing neural network approaches, we show that the number of parameters of the proposed approach grows linearly with respect to the number of tasks, and does not sacrifice plasticity to scale. Experiments conducted in benchmark continuous control and visual problems reveal that the proposed approach achieves greater knowledge transfer and performance than alternative methods.
title Self-Composing Policies for Scalable Continual Reinforcement Learning
topic Machine Learning
url https://arxiv.org/abs/2506.14811