Rényi entropy for multivariate controlled autoregressive moving average systems
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2021
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917040722280448 |
|---|---|
| author | Abid, Salah H. Quaez, Uday J. Contreras-Reyescor, Javier E. |
| author_facet | Abid, Salah H. Quaez, Uday J. Contreras-Reyescor, Javier E. |
| contents | Rényi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In this paper, we study in detail this measure for multivariate controlled autoregressive moving average (MCARMA) systems. The characteristic function of output process is represented from the terms of its residual characteristic function. An explicit formula to compute the Rényi entropy for the output process of MCARMA system is derived. In addition, we investigate the covariance matrix to find the upper bound of Rényi entropy. We present three simulations that serve to illustrate the behavior of information in MCARMA system, where the control and noise follow the Gaussian, Cauchy and Laplace distributions. Finally, the behaviour of Rényi entropy is illustrated in two real-world applications: a paper-making process and an electric circuit system. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2103_07608 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Rényi entropy for multivariate controlled autoregressive moving average systems Abid, Salah H. Quaez, Uday J. Contreras-Reyescor, Javier E. Statistics Theory Rényi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In this paper, we study in detail this measure for multivariate controlled autoregressive moving average (MCARMA) systems. The characteristic function of output process is represented from the terms of its residual characteristic function. An explicit formula to compute the Rényi entropy for the output process of MCARMA system is derived. In addition, we investigate the covariance matrix to find the upper bound of Rényi entropy. We present three simulations that serve to illustrate the behavior of information in MCARMA system, where the control and noise follow the Gaussian, Cauchy and Laplace distributions. Finally, the behaviour of Rényi entropy is illustrated in two real-world applications: a paper-making process and an electric circuit system. |
| title | Rényi entropy for multivariate controlled autoregressive moving average systems |
| topic | Statistics Theory |
| url | https://arxiv.org/abs/2103.07608 |