Saved in:
Bibliographic Details
Main Authors: Bourigault, Pauline, Xu, Dongpo, Mandic, Danilo P.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.14227
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866907851641847808
author Bourigault, Pauline
Xu, Dongpo
Mandic, Danilo P.
author_facet Bourigault, Pauline
Xu, Dongpo
Mandic, Danilo P.
contents We develop a robust quaternion recurrent neural network (QRNN) for real-time processing of 3D and 4D data with outliers. This is achieved by combining the real-time recurrent learning (RTRL) algorithm and the maximum correntropy criterion (MCC) as a loss function. While both the mean square error and maximum correntropy criterion are viable cost functions, it is shown that the non-quadratic maximum correntropy loss function is less sensitive to outliers, making it suitable for applications with multidimensional noisy or uncertain data. Both algorithms are derived based on the novel generalised HR (GHR) calculus, which allows for the differentiation of real functions of quaternion variables and offers the product and chain rules, thus enabling elegant and compact derivations. Simulation results in the context of motion prediction of chest internal markers for lung cancer radiotherapy, which includes regular and irregular breathing sequences, support the analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2402_14227
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Quaternion recurrent neural network with real-time recurrent learning and maximum correntropy criterion
Bourigault, Pauline
Xu, Dongpo
Mandic, Danilo P.
Machine Learning
We develop a robust quaternion recurrent neural network (QRNN) for real-time processing of 3D and 4D data with outliers. This is achieved by combining the real-time recurrent learning (RTRL) algorithm and the maximum correntropy criterion (MCC) as a loss function. While both the mean square error and maximum correntropy criterion are viable cost functions, it is shown that the non-quadratic maximum correntropy loss function is less sensitive to outliers, making it suitable for applications with multidimensional noisy or uncertain data. Both algorithms are derived based on the novel generalised HR (GHR) calculus, which allows for the differentiation of real functions of quaternion variables and offers the product and chain rules, thus enabling elegant and compact derivations. Simulation results in the context of motion prediction of chest internal markers for lung cancer radiotherapy, which includes regular and irregular breathing sequences, support the analysis.
title Quaternion recurrent neural network with real-time recurrent learning and maximum correntropy criterion
topic Machine Learning
url https://arxiv.org/abs/2402.14227