An Approach to Variable Clustering: K-means in Transposed Data and its Relationship with Principal Component Analysis

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Saquicela, Victor, Palacio-Baus, Kenneth, Chifla, Mario
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912739823190016
author Saquicela, Victor
Palacio-Baus, Kenneth
Chifla, Mario
author_facet Saquicela, Victor
Palacio-Baus, Kenneth
Chifla, Mario
contents Principal Component Analysis (PCA) and K-means constitute fundamental techniques in multivariate analysis. Although they are frequently applied independently or sequentially to cluster observations, the relationship between them, especially when K-means is used to cluster variables rather than observations, has been scarcely explored. This study seeks to address this gap by proposing an innovative method that analyzes the relationship between clusters of variables obtained by applying K-means on transposed data and the principal components of PCA. Our approach involves applying PCA to the original data and K-means to the transposed data set, where the original variables are converted into observations. The contribution of each variable cluster to each principal component is then quantified using measures based on variable loadings. This process provides a tool to explore and understand the clustering of variables and how such clusters contribute to the principal dimensions of variation identified by PCA.
format Preprint
id arxiv_https___arxiv_org_abs_2512_00979
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Approach to Variable Clustering: K-means in Transposed Data and its Relationship with Principal Component Analysis
Saquicela, Victor
Palacio-Baus, Kenneth
Chifla, Mario
Machine Learning
Artificial Intelligence
Principal Component Analysis (PCA) and K-means constitute fundamental techniques in multivariate analysis. Although they are frequently applied independently or sequentially to cluster observations, the relationship between them, especially when K-means is used to cluster variables rather than observations, has been scarcely explored. This study seeks to address this gap by proposing an innovative method that analyzes the relationship between clusters of variables obtained by applying K-means on transposed data and the principal components of PCA. Our approach involves applying PCA to the original data and K-means to the transposed data set, where the original variables are converted into observations. The contribution of each variable cluster to each principal component is then quantified using measures based on variable loadings. This process provides a tool to explore and understand the clustering of variables and how such clusters contribute to the principal dimensions of variation identified by PCA.
title An Approach to Variable Clustering: K-means in Transposed Data and its Relationship with Principal Component Analysis
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2512.00979