An Analytical Approach to the Jaccard Similarity Index

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Travieso, Gonzalo, Benatti, Alexandre, Costa, Luciano da F.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917812371456000
author Travieso, Gonzalo
Benatti, Alexandre
Costa, Luciano da F.
author_facet Travieso, Gonzalo
Benatti, Alexandre
Costa, Luciano da F.
contents The Jaccard similarity index has often been employed in science and technology as a means to quantify the similarity between two sets. When modified to operate on real-valued values, the Jaccard similarity index can be applied to compare vectors, an operation which plays a central role in visualization, classification, and modeling. The present work aims at developing an analytical approach for estimating the probability density of the Jaccard similarity values as implied by set of data elements characterized by specific statistical densities, with emphasis on the uniform and normal cases. Several theoretical and practical situations can benefit directly from such an approach, as it allows several of the properties of the similarity comparisons among a given dataset to be better understood and anticipated. Situations in which the described approach can be applied include the estimation and visualization of data interrelationships in terms of similarity networks, as well as diverse problems in data analysis, pattern recognition and scientific modeling. In addition to presenting the analytical developments and results, examples are also provided in order to illustrate the potential of the approach. The work also includes extension of the reported developments to modifications of the Jaccard index intended for regularization and control of the sharpness of the implemented comparisons.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16436
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An Analytical Approach to the Jaccard Similarity Index
Travieso, Gonzalo
Benatti, Alexandre
Costa, Luciano da F.
Data Analysis, Statistics and Probability
The Jaccard similarity index has often been employed in science and technology as a means to quantify the similarity between two sets. When modified to operate on real-valued values, the Jaccard similarity index can be applied to compare vectors, an operation which plays a central role in visualization, classification, and modeling. The present work aims at developing an analytical approach for estimating the probability density of the Jaccard similarity values as implied by set of data elements characterized by specific statistical densities, with emphasis on the uniform and normal cases. Several theoretical and practical situations can benefit directly from such an approach, as it allows several of the properties of the similarity comparisons among a given dataset to be better understood and anticipated. Situations in which the described approach can be applied include the estimation and visualization of data interrelationships in terms of similarity networks, as well as diverse problems in data analysis, pattern recognition and scientific modeling. In addition to presenting the analytical developments and results, examples are also provided in order to illustrate the potential of the approach. The work also includes extension of the reported developments to modifications of the Jaccard index intended for regularization and control of the sharpness of the implemented comparisons.
title An Analytical Approach to the Jaccard Similarity Index
topic Data Analysis, Statistics and Probability
url https://arxiv.org/abs/2410.16436