A High-Dimensional Feature Selection Algorithm Based on Multiobjective Differential Evolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Zhenxing, An, Qianxiang, Wang, Yilei, Wu, Chenfeng, Dong, Baoling, Zhou, Chunjie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909605862309888
author Zhang, Zhenxing
An, Qianxiang
Wang, Yilei
Wu, Chenfeng
Dong, Baoling
Zhou, Chunjie
author_facet Zhang, Zhenxing
An, Qianxiang
Wang, Yilei
Wu, Chenfeng
Dong, Baoling
Zhou, Chunjie
contents Multiobjective feature selection seeks to determine the most discriminative feature subset by simultaneously optimizing two conflicting objectives: minimizing the number of selected features and the classification error rate. The goal is to enhance the model's predictive performance and computational efficiency. However, feature redundancy and interdependence in high-dimensional data present considerable obstacles to the search efficiency of optimization algorithms and the quality of the resulting solutions. To tackle these issues, we propose a high-dimensional feature selection algorithm based on multiobjective differential evolution. First, a population initialization strategy is designed by integrating feature weights and redundancy indices, where the population is divided into four subpopulations to improve the diversity and uniformity of the initial population. Then, a multiobjective selection mechanism is developed, in which feature weights guide the mutation process. The solution quality is further enhanced through nondominated sorting, with preference given to solutions with lower classification error, effectively balancing global exploration and local exploitation. Finally, an adaptive grid mechanism is applied in the objective space to identify densely populated regions and detect duplicated solutions. Experimental results on 11 UCI datasets of varying difficulty demonstrate that the proposed method significantly outperforms several state-of-the-art multiobjective feature selection approaches regarding feature selection performance.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05727
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A High-Dimensional Feature Selection Algorithm Based on Multiobjective Differential Evolution
Zhang, Zhenxing
An, Qianxiang
Wang, Yilei
Wu, Chenfeng
Dong, Baoling
Zhou, Chunjie
Neural and Evolutionary Computing
Multiobjective feature selection seeks to determine the most discriminative feature subset by simultaneously optimizing two conflicting objectives: minimizing the number of selected features and the classification error rate. The goal is to enhance the model's predictive performance and computational efficiency. However, feature redundancy and interdependence in high-dimensional data present considerable obstacles to the search efficiency of optimization algorithms and the quality of the resulting solutions. To tackle these issues, we propose a high-dimensional feature selection algorithm based on multiobjective differential evolution. First, a population initialization strategy is designed by integrating feature weights and redundancy indices, where the population is divided into four subpopulations to improve the diversity and uniformity of the initial population. Then, a multiobjective selection mechanism is developed, in which feature weights guide the mutation process. The solution quality is further enhanced through nondominated sorting, with preference given to solutions with lower classification error, effectively balancing global exploration and local exploitation. Finally, an adaptive grid mechanism is applied in the objective space to identify densely populated regions and detect duplicated solutions. Experimental results on 11 UCI datasets of varying difficulty demonstrate that the proposed method significantly outperforms several state-of-the-art multiobjective feature selection approaches regarding feature selection performance.
title A High-Dimensional Feature Selection Algorithm Based on Multiobjective Differential Evolution
topic Neural and Evolutionary Computing
url https://arxiv.org/abs/2505.05727