cPNN: Continuous Progressive Neural Networks for Evolving Streaming Time Series

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Giannini, Federico, Ziffer, Giacomo, Della Valle, Emanuele
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911482518700032
author Giannini, Federico
Ziffer, Giacomo
Della Valle, Emanuele
author_facet Giannini, Federico
Ziffer, Giacomo
Della Valle, Emanuele
contents Dealing with an unbounded data stream involves overcoming the assumption that data is identically distributed and independent. A data stream can, in fact, exhibit temporal dependencies (i.e., be a time series), and data can change distribution over time (concept drift). The two problems are deeply discussed, and existing solutions address them separately: a joint solution is absent. In addition, learning multiple concepts implies remembering the past (a.k.a. avoiding catastrophic forgetting in Neural Networks' terminology). This work proposes Continuous Progressive Neural Networks (cPNN), a solution that tames concept drifts, handles temporal dependencies, and bypasses catastrophic forgetting. cPNN is a continuous version of Progressive Neural Networks, a methodology for remembering old concepts and transferring past knowledge to fit the new concepts quickly. We base our method on Recurrent Neural Networks and exploit the Stochastic Gradient Descent applied to data streams with temporal dependencies. Results of an ablation study show a quick adaptation of cPNN to new concepts and robustness to drifts.
format Preprint
id arxiv_https___arxiv_org_abs_2603_03040
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle cPNN: Continuous Progressive Neural Networks for Evolving Streaming Time Series
Giannini, Federico
Ziffer, Giacomo
Della Valle, Emanuele
Machine Learning
Artificial Intelligence
68T05, 68T07
I.2.6; I.2.7
Dealing with an unbounded data stream involves overcoming the assumption that data is identically distributed and independent. A data stream can, in fact, exhibit temporal dependencies (i.e., be a time series), and data can change distribution over time (concept drift). The two problems are deeply discussed, and existing solutions address them separately: a joint solution is absent. In addition, learning multiple concepts implies remembering the past (a.k.a. avoiding catastrophic forgetting in Neural Networks' terminology). This work proposes Continuous Progressive Neural Networks (cPNN), a solution that tames concept drifts, handles temporal dependencies, and bypasses catastrophic forgetting. cPNN is a continuous version of Progressive Neural Networks, a methodology for remembering old concepts and transferring past knowledge to fit the new concepts quickly. We base our method on Recurrent Neural Networks and exploit the Stochastic Gradient Descent applied to data streams with temporal dependencies. Results of an ablation study show a quick adaptation of cPNN to new concepts and robustness to drifts.
title cPNN: Continuous Progressive Neural Networks for Evolving Streaming Time Series
topic Machine Learning
Artificial Intelligence
68T05, 68T07
I.2.6; I.2.7
url https://arxiv.org/abs/2603.03040