Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dang, Gang, Wang, Dianhui
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913565789650944
author Dang, Gang
Wang, Dianhui
author_facet Dang, Gang
Wang, Dianhui
contents Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic systems. DeepRSCNs are incrementally constructed, with all reservoir nodes directly linked to the final output. The random parameters are assigned in the light of a supervisory mechanism, ensuring the universal approximation property of the built model. The output weights are updated online using the projection algorithm to handle the unknown dynamics. Given a set of training samples, DeepRSCNs can quickly generate learning representations, which consist of random basis functions with cascaded input and readout weights. Experimental results over a time series prediction, a nonlinear system identification problem, and two industrial data predictive analyses demonstrate that the proposed DeepRSCN outperforms the single-layer network in terms of modelling efficiency, learning capability, and generalization performance.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20904
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems
Dang, Gang
Wang, Dianhui
Machine Learning
Dynamical Systems
Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic systems. DeepRSCNs are incrementally constructed, with all reservoir nodes directly linked to the final output. The random parameters are assigned in the light of a supervisory mechanism, ensuring the universal approximation property of the built model. The output weights are updated online using the projection algorithm to handle the unknown dynamics. Given a set of training samples, DeepRSCNs can quickly generate learning representations, which consist of random basis functions with cascaded input and readout weights. Experimental results over a time series prediction, a nonlinear system identification problem, and two industrial data predictive analyses demonstrate that the proposed DeepRSCN outperforms the single-layer network in terms of modelling efficiency, learning capability, and generalization performance.
title Deep Recurrent Stochastic Configuration Networks for Modelling Nonlinear Dynamic Systems
topic Machine Learning
Dynamical Systems
url https://arxiv.org/abs/2410.20904