An Analysis of Minimum Error Entropy Loss Functions in Wireless Communications

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pallewela, Rumeshika, Eldeeb, Eslam, Alves, Hirley
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929570669658112
author Pallewela, Rumeshika
Eldeeb, Eslam
Alves, Hirley
author_facet Pallewela, Rumeshika
Eldeeb, Eslam
Alves, Hirley
contents This paper introduces the minimum error entropy (MEE) criterion as an advanced information-theoretic loss function tailored for deep learning applications in wireless communications. The MEE criterion leverages higher-order statistical properties, offering robustness in noisy scenarios like Rayleigh fading and impulsive interference. In addition, we propose a less computationally complex version of the MEE function to enhance practical usability in wireless communications. The method is evaluated through simulations on two critical applications: over-the-air regression and indoor localization. Results indicate that the MEE criterion outperforms conventional loss functions, such as mean squared error (MSE) and mean absolute error (MAE), achieving significant performance improvements in terms of accuracy, over $20 \%$ gain over traditional methods, and convergence speed across various channel conditions. This work establishes MEE as a promising alternative for wireless communication tasks in deep learning models, enabling better resilience and adaptability.
format Preprint
id arxiv_https___arxiv_org_abs_2410_07208
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An Analysis of Minimum Error Entropy Loss Functions in Wireless Communications
Pallewela, Rumeshika
Eldeeb, Eslam
Alves, Hirley
Information Theory
Machine Learning
Signal Processing
This paper introduces the minimum error entropy (MEE) criterion as an advanced information-theoretic loss function tailored for deep learning applications in wireless communications. The MEE criterion leverages higher-order statistical properties, offering robustness in noisy scenarios like Rayleigh fading and impulsive interference. In addition, we propose a less computationally complex version of the MEE function to enhance practical usability in wireless communications. The method is evaluated through simulations on two critical applications: over-the-air regression and indoor localization. Results indicate that the MEE criterion outperforms conventional loss functions, such as mean squared error (MSE) and mean absolute error (MAE), achieving significant performance improvements in terms of accuracy, over $20 \%$ gain over traditional methods, and convergence speed across various channel conditions. This work establishes MEE as a promising alternative for wireless communication tasks in deep learning models, enabling better resilience and adaptability.
title An Analysis of Minimum Error Entropy Loss Functions in Wireless Communications
topic Information Theory
Machine Learning
Signal Processing
url https://arxiv.org/abs/2410.07208