Saved in:
Bibliographic Details
Main Authors: Liang, Yunhui, Gan, Jianwen, Chen, Yan, Zhou, Peng, Du, Liang
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.20388
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913565481369600
author Liang, Yunhui
Gan, Jianwen
Chen, Yan
Zhou, Peng
Du, Liang
author_facet Liang, Yunhui
Gan, Jianwen
Chen, Yan
Zhou, Peng
Du, Liang
contents High-dimensional data is commonly encountered in numerous data analysis tasks. Feature selection techniques aim to identify the most representative features from the original high-dimensional data. Due to the absence of class label information, it is significantly more challenging to select appropriate features in unsupervised learning scenarios compared to supervised ones. Traditional unsupervised feature selection methods typically score the features of samples based on certain criteria, treating samples indiscriminately. However, these approaches fail to fully capture the internal structure of the data. The importance of different samples should vary, and there is a dual relationship between the weight of samples and features that will influence each other. Therefore, an unsupervised feature selection algorithm based on dual manifold re-ranking (DMRR) is proposed in this paper. Different similarity matrices are constructed to depict the manifold structures among samples, between samples and features, and among features themselves. Then, manifold re-ranking is performed by combining the initial scores of samples and features. By comparing DMRR with three original unsupervised feature selection algorithms and two unsupervised feature selection post-processing algorithms, experimental results confirm that the importance information of different samples and the dual relationship between sample and feature are beneficial for achieving better feature selection.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20388
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking
Liang, Yunhui
Gan, Jianwen
Chen, Yan
Zhou, Peng
Du, Liang
Machine Learning
High-dimensional data is commonly encountered in numerous data analysis tasks. Feature selection techniques aim to identify the most representative features from the original high-dimensional data. Due to the absence of class label information, it is significantly more challenging to select appropriate features in unsupervised learning scenarios compared to supervised ones. Traditional unsupervised feature selection methods typically score the features of samples based on certain criteria, treating samples indiscriminately. However, these approaches fail to fully capture the internal structure of the data. The importance of different samples should vary, and there is a dual relationship between the weight of samples and features that will influence each other. Therefore, an unsupervised feature selection algorithm based on dual manifold re-ranking (DMRR) is proposed in this paper. Different similarity matrices are constructed to depict the manifold structures among samples, between samples and features, and among features themselves. Then, manifold re-ranking is performed by combining the initial scores of samples and features. By comparing DMRR with three original unsupervised feature selection algorithms and two unsupervised feature selection post-processing algorithms, experimental results confirm that the importance information of different samples and the dual relationship between sample and feature are beneficial for achieving better feature selection.
title Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking
topic Machine Learning
url https://arxiv.org/abs/2410.20388