Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Attallah, Mustafa
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912018027511808
author Attallah, Mustafa
author_facet Attallah, Mustafa
contents This article examines the limitations of Pearson's correlation in selecting predictor variables for linear models. Using mtcars and iris datasets from R, this paper demonstrates the limitation of this correlation measure when selecting a proper independent variable to model miles per gallon (mpg) from mtcars data and the petal length from the iris data. This paper exhibits the findings by reporting Pearson's correlation values for two potential predictor variables for each response variable, then builds a linear model to predict the response variable using each predictor variable. The error metrics for each model are then reported to evaluate how reliable Pearson's correlation is in selecting the best predictor variable. The results show that Pearson's correlation can be deceiving if used to select the predictor variable to build a linear model for a dependent variable.
format Preprint
id arxiv_https___arxiv_org_abs_2409_01295
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models
Attallah, Mustafa
Methodology
This article examines the limitations of Pearson's correlation in selecting predictor variables for linear models. Using mtcars and iris datasets from R, this paper demonstrates the limitation of this correlation measure when selecting a proper independent variable to model miles per gallon (mpg) from mtcars data and the petal length from the iris data. This paper exhibits the findings by reporting Pearson's correlation values for two potential predictor variables for each response variable, then builds a linear model to predict the response variable using each predictor variable. The error metrics for each model are then reported to evaluate how reliable Pearson's correlation is in selecting the best predictor variable. The results show that Pearson's correlation can be deceiving if used to select the predictor variable to build a linear model for a dependent variable.
title Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models
topic Methodology
url https://arxiv.org/abs/2409.01295