Entropy measures and their applications: A comprehensive review
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909545062727680 |
|---|---|
| author | Kumar, Naveen Dixit, Ambesh Vijay, Vivek |
| author_facet | Kumar, Naveen Dixit, Ambesh Vijay, Vivek |
| contents | Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical foundations and practical applications, is crucial to advance research across disciplines. This review article provides motivation, fundamental properties, and constraints of various entropy measures. These measures are categorized with time evolution ranging from Shannon entropy generalizations, distribution function theory, fuzzy theory, fractional calculus to graph theory, all explained in a simplified and accessible manner. These entropy measures are selected on the basis of their usability, with descriptions arranged chronologically. We have further discussed the applicability of these measures across different domains, including thermodynamics, communication theory, financial engineering, categorical data, artificial intelligence, signal processing, and chemical and biological systems, highlighting their multifaceted roles. A number of examples are included to demonstrate the prominence of specific measures in terms of their applicability. The article also focuses on entropy-based applications in different disciplines, emphasizing openly accessible resources. Furthermore, this article emphasizes the applicability of various entropy measures in the field of finance. The article may provide a good insight to the researchers and experts working to quantify uncertainties, along with potential future directions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_15660 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Entropy measures and their applications: A comprehensive review Kumar, Naveen Dixit, Ambesh Vijay, Vivek Probability Data Analysis, Statistics and Probability 94A17, 28D20, 60E05 Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical foundations and practical applications, is crucial to advance research across disciplines. This review article provides motivation, fundamental properties, and constraints of various entropy measures. These measures are categorized with time evolution ranging from Shannon entropy generalizations, distribution function theory, fuzzy theory, fractional calculus to graph theory, all explained in a simplified and accessible manner. These entropy measures are selected on the basis of their usability, with descriptions arranged chronologically. We have further discussed the applicability of these measures across different domains, including thermodynamics, communication theory, financial engineering, categorical data, artificial intelligence, signal processing, and chemical and biological systems, highlighting their multifaceted roles. A number of examples are included to demonstrate the prominence of specific measures in terms of their applicability. The article also focuses on entropy-based applications in different disciplines, emphasizing openly accessible resources. Furthermore, this article emphasizes the applicability of various entropy measures in the field of finance. The article may provide a good insight to the researchers and experts working to quantify uncertainties, along with potential future directions. |
| title | Entropy measures and their applications: A comprehensive review |
| topic | Probability Data Analysis, Statistics and Probability 94A17, 28D20, 60E05 |
| url | https://arxiv.org/abs/2503.15660 |