Focusing on a Probability Element: Parameter Selection of Message Importance Measure in Big Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2017
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911828014006272 |
|---|---|
| author | She, Rui Liu, Shanyun Dong, Yunquan Fan, Pingyi |
| author_facet | She, Rui Liu, Shanyun Dong, Yunquan Fan, Pingyi |
| contents | Message importance measure (MIM) is applicable to characterize the importance of information in the scenario of big data, similar to entropy in information theory. In fact, MIM with a variable parameter can make an effect on the characterization of distribution. Furthermore, by choosing an appropriate parameter of MIM, it is possible to emphasize the message importance of a certain probability element in a distribution. Therefore, parametric MIM can play a vital role in anomaly detection of big data by focusing on probability of an anomalous event. In this paper, we propose a parameter selection method of MIM focusing on a probability element and then present its major properties. In addition, we discuss the parameter selection with prior probability, and investigate the availability in a statistical processing model of big data for anomaly detection problem. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1701_03234 |
| institution | arXiv |
| publishDate | 2017 |
| record_format | arxiv |
| spellingShingle | Focusing on a Probability Element: Parameter Selection of Message Importance Measure in Big Data She, Rui Liu, Shanyun Dong, Yunquan Fan, Pingyi Information Theory Message importance measure (MIM) is applicable to characterize the importance of information in the scenario of big data, similar to entropy in information theory. In fact, MIM with a variable parameter can make an effect on the characterization of distribution. Furthermore, by choosing an appropriate parameter of MIM, it is possible to emphasize the message importance of a certain probability element in a distribution. Therefore, parametric MIM can play a vital role in anomaly detection of big data by focusing on probability of an anomalous event. In this paper, we propose a parameter selection method of MIM focusing on a probability element and then present its major properties. In addition, we discuss the parameter selection with prior probability, and investigate the availability in a statistical processing model of big data for anomaly detection problem. |
| title | Focusing on a Probability Element: Parameter Selection of Message Importance Measure in Big Data |
| topic | Information Theory |
| url | https://arxiv.org/abs/1701.03234 |