Continual Learning and Catastrophic Forgetting

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: van de Ven, Gido M., Soures, Nicholas, Kudithipudi, Dhireesha
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908528978952192
author van de Ven, Gido M.
Soures, Nicholas
Kudithipudi, Dhireesha
author_facet van de Ven, Gido M.
Soures, Nicholas
Kudithipudi, Dhireesha
contents This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data. Although continual learning is a natural skill for the human brain, it is very challenging for artificial neural networks. An important reason is that, when learning something new, these networks tend to quickly and drastically forget what they had learned before, a phenomenon known as catastrophic forgetting. Especially in the last decade, continual learning has become an extensively studied topic in deep learning. This book chapter reviews the insights that this field has generated.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05175
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Continual Learning and Catastrophic Forgetting
van de Ven, Gido M.
Soures, Nicholas
Kudithipudi, Dhireesha
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Neurons and Cognition
This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data. Although continual learning is a natural skill for the human brain, it is very challenging for artificial neural networks. An important reason is that, when learning something new, these networks tend to quickly and drastically forget what they had learned before, a phenomenon known as catastrophic forgetting. Especially in the last decade, continual learning has become an extensively studied topic in deep learning. This book chapter reviews the insights that this field has generated.
title Continual Learning and Catastrophic Forgetting
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Neurons and Cognition
url https://arxiv.org/abs/2403.05175