Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Erden, Zeki Doruk, Gasmi, Donia, Faltings, Boi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910942127718400
author Erden, Zeki Doruk
Gasmi, Donia
Faltings, Boi
author_facet Erden, Zeki Doruk
Gasmi, Donia
Faltings, Boi
contents Continual learning for reinforcement learning agents remains a significant challenge, particularly in preserving and leveraging existing information without an external signal to indicate changes in tasks or environments. In this study, we explore the effectiveness of autoencoders in detecting new tasks and matching observed environments to previously encountered ones. Our approach integrates policy optimization with familiarity autoencoders within an end-to-end continual learning system. This system can recognize and learn new tasks or environments while preserving knowledge from earlier experiences and can selectively retrieve relevant knowledge when re-encountering a known environment. Initial results demonstrate successful continual learning without external signals to indicate task changes or reencounters, showing promise for this methodology.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09003
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognition
Erden, Zeki Doruk
Gasmi, Donia
Faltings, Boi
Machine Learning
Artificial Intelligence
Continual learning for reinforcement learning agents remains a significant challenge, particularly in preserving and leveraging existing information without an external signal to indicate changes in tasks or environments. In this study, we explore the effectiveness of autoencoders in detecting new tasks and matching observed environments to previously encountered ones. Our approach integrates policy optimization with familiarity autoencoders within an end-to-end continual learning system. This system can recognize and learn new tasks or environments while preserving knowledge from earlier experiences and can selectively retrieve relevant knowledge when re-encountering a known environment. Initial results demonstrate successful continual learning without external signals to indicate task changes or reencounters, showing promise for this methodology.
title Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognition
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2505.09003