Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.18459 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914883334832128 |
|---|---|
| author | Wang, Zhangyu Janowicz, Krzysztof Mai, Gengchen Majic, Ivan |
| author_facet | Wang, Zhangyu Janowicz, Krzysztof Mai, Gengchen Majic, Ivan |
| contents | Intuitively, there is a relation between measures of spatial dependence and information theoretical measures of entropy. For instance, we can provide an intuition of why spatial data is special by stating that, on average, spatial data samples contain less than expected information. Similarly, spatial data, e.g., remotely sensed imagery, that is easy to compress is also likely to show significant spatial autocorrelation. Formulating our (highly specific) core concepts of spatial information theory in the widely used language of information theory opens new perspectives on their differences and similarities and also fosters cross-disciplinary collaboration, e.g., with the broader AI/ML communities. Interestingly, however, this intuitive relation is challenging to formalize and generalize, leading prior work to rely mostly on experimental results, e.g., for describing landscape patterns. In this work, we will explore the information theoretical roots of spatial autocorrelation, more specifically Moran's I, through the lens of self-information (also known as surprisal) and provide both formal proofs and experiments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_18459 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Probing the Information Theoretical Roots of Spatial Dependence Measures Wang, Zhangyu Janowicz, Krzysztof Mai, Gengchen Majic, Ivan Information Theory Artificial Intelligence Machine Learning Methodology Intuitively, there is a relation between measures of spatial dependence and information theoretical measures of entropy. For instance, we can provide an intuition of why spatial data is special by stating that, on average, spatial data samples contain less than expected information. Similarly, spatial data, e.g., remotely sensed imagery, that is easy to compress is also likely to show significant spatial autocorrelation. Formulating our (highly specific) core concepts of spatial information theory in the widely used language of information theory opens new perspectives on their differences and similarities and also fosters cross-disciplinary collaboration, e.g., with the broader AI/ML communities. Interestingly, however, this intuitive relation is challenging to formalize and generalize, leading prior work to rely mostly on experimental results, e.g., for describing landscape patterns. In this work, we will explore the information theoretical roots of spatial autocorrelation, more specifically Moran's I, through the lens of self-information (also known as surprisal) and provide both formal proofs and experiments. |
| title | Probing the Information Theoretical Roots of Spatial Dependence Measures |
| topic | Information Theory Artificial Intelligence Machine Learning Methodology |
| url | https://arxiv.org/abs/2405.18459 |