Discovering and Deciphering Relationships Across Disparate Data Modalities

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Vogelstein, Joshua T., Bridgeford, Eric, Wang, Qing, Priebe, Carey E., Maggioni, Mauro, Shen, Cencheng
Format: Preprint
Veröffentlicht: 2016
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914848852410368
author Vogelstein, Joshua T.
Bridgeford, Eric
Wang, Qing
Priebe, Carey E.
Maggioni, Mauro
Shen, Cencheng
author_facet Vogelstein, Joshua T.
Bridgeford, Eric
Wang, Qing
Priebe, Carey E.
Maggioni, Mauro
Shen, Cencheng
contents Understanding the relationships between different properties of data, such as whether a connectome or genome has information about disease status, is becoming increasingly important in modern biological datasets. While existing approaches can test whether two properties are related, they often require unfeasibly large sample sizes in real data scenarios, and do not provide any insight into how or why the procedure reached its decision. Our approach, "Multiscale Graph Correlation" (MGC), is a dependence test that juxtaposes previously disparate data science techniques, including k-nearest neighbors, kernel methods (such as support vector machines), and multiscale analysis (such as wavelets). Other methods typically require double or triple the number samples to achieve the same statistical power as MGC in a benchmark suite including high-dimensional and nonlinear relationships - spanning polynomial (linear, quadratic, cubic), trigonometric (sinusoidal, circular, ellipsoidal, spiral), geometric (square, diamond, W-shape), and other functions, with dimensionality ranging from 1 to 1000. Moreover, MGC uniquely provides a simple and elegant characterization of the potentially complex latent geometry underlying the relationship, providing insight while maintaining computational efficiency. In several real data applications, including brain imaging and cancer genetics, MGC is the only method that can both detect the presence of a dependency and provide specific guidance for the next experiment and/or analysis to conduct.
format Preprint
id arxiv_https___arxiv_org_abs_1609_05148
institution arXiv
publishDate 2016
record_format arxiv
spellingShingle Discovering and Deciphering Relationships Across Disparate Data Modalities
Vogelstein, Joshua T.
Bridgeford, Eric
Wang, Qing
Priebe, Carey E.
Maggioni, Mauro
Shen, Cencheng
Machine Learning
Understanding the relationships between different properties of data, such as whether a connectome or genome has information about disease status, is becoming increasingly important in modern biological datasets. While existing approaches can test whether two properties are related, they often require unfeasibly large sample sizes in real data scenarios, and do not provide any insight into how or why the procedure reached its decision. Our approach, "Multiscale Graph Correlation" (MGC), is a dependence test that juxtaposes previously disparate data science techniques, including k-nearest neighbors, kernel methods (such as support vector machines), and multiscale analysis (such as wavelets). Other methods typically require double or triple the number samples to achieve the same statistical power as MGC in a benchmark suite including high-dimensional and nonlinear relationships - spanning polynomial (linear, quadratic, cubic), trigonometric (sinusoidal, circular, ellipsoidal, spiral), geometric (square, diamond, W-shape), and other functions, with dimensionality ranging from 1 to 1000. Moreover, MGC uniquely provides a simple and elegant characterization of the potentially complex latent geometry underlying the relationship, providing insight while maintaining computational efficiency. In several real data applications, including brain imaging and cancer genetics, MGC is the only method that can both detect the presence of a dependency and provide specific guidance for the next experiment and/or analysis to conduct.
title Discovering and Deciphering Relationships Across Disparate Data Modalities
topic Machine Learning
url https://arxiv.org/abs/1609.05148