Saved in:
Bibliographic Details
Main Authors: Sahtout, Mohammad Omar, Wang, Haiyan, Ghimire, Santosh
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2501.00632
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910769181884416
author Sahtout, Mohammad Omar
Wang, Haiyan
Ghimire, Santosh
author_facet Sahtout, Mohammad Omar
Wang, Haiyan
Ghimire, Santosh
contents This article considers the impact of different thresholding methods to the Nearest Shrunken Centroid algorithm, which is popularly referred as the Prediction Analysis of Microarrays (PAM) for high-dimensional classification. PAM uses soft thresholding to achieve high computational efficiency and high classification accuracy but in the price of retaining too many features. When applied to microarray human cancers, PAM selected 2611 features on average from 10 multi-class datasets. Such a large number of features make it difficult to perform follow up study. One reason behind this problem is the soft thresholding, which is known to produce biased parameter estimate in regression analysis. In this article, we extend the PAM algorithm with two other thresholding methods, hard and order thresholding, and a deep search algorithm to achieve better thresholding parameter estimate. The modified algorithms are extensively tested and compared to the original one based on real data and Monte Carlo studies. In general, the modification not only gave better cancer status prediction accuracy, but also resulted in more parsimonious models with significantly smaller number of features.
format Preprint
id arxiv_https___arxiv_org_abs_2501_00632
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Different thresholding methods on Nearest Shrunken Centroid algorithm
Sahtout, Mohammad Omar
Wang, Haiyan
Ghimire, Santosh
Machine Learning
This article considers the impact of different thresholding methods to the Nearest Shrunken Centroid algorithm, which is popularly referred as the Prediction Analysis of Microarrays (PAM) for high-dimensional classification. PAM uses soft thresholding to achieve high computational efficiency and high classification accuracy but in the price of retaining too many features. When applied to microarray human cancers, PAM selected 2611 features on average from 10 multi-class datasets. Such a large number of features make it difficult to perform follow up study. One reason behind this problem is the soft thresholding, which is known to produce biased parameter estimate in regression analysis. In this article, we extend the PAM algorithm with two other thresholding methods, hard and order thresholding, and a deep search algorithm to achieve better thresholding parameter estimate. The modified algorithms are extensively tested and compared to the original one based on real data and Monte Carlo studies. In general, the modification not only gave better cancer status prediction accuracy, but also resulted in more parsimonious models with significantly smaller number of features.
title Different thresholding methods on Nearest Shrunken Centroid algorithm
topic Machine Learning
url https://arxiv.org/abs/2501.00632