Differential Set Selection via Confidence-Guided Entropy Minimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Romero, María del Carmen, del Fresno, Mariana, Clausse, Alejandro
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917052773564416
author Romero, María del Carmen
del Fresno, Mariana
Clausse, Alejandro
author_facet Romero, María del Carmen
del Fresno, Mariana
Clausse, Alejandro
contents This paper addresses the challenge of identifying a minimal subset of discrete, independent variables that best predicts a binary class. We propose an efficient iterative method that sequentially selects variables based on which one provides the most statistically significant reduction in conditional entropy, using confidence bounds to account for finite-sample uncertainty. Tests on simulated data demonstrate the method's ability to correctly identify influential variables while minimizing spurious selections, even with small sample sizes, offering a computationally tractable solution to this NP-complete problem.
format Preprint
id arxiv_https___arxiv_org_abs_2510_27479
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Differential Set Selection via Confidence-Guided Entropy Minimization
Romero, María del Carmen
del Fresno, Mariana
Clausse, Alejandro
Computation
This paper addresses the challenge of identifying a minimal subset of discrete, independent variables that best predicts a binary class. We propose an efficient iterative method that sequentially selects variables based on which one provides the most statistically significant reduction in conditional entropy, using confidence bounds to account for finite-sample uncertainty. Tests on simulated data demonstrate the method's ability to correctly identify influential variables while minimizing spurious selections, even with small sample sizes, offering a computationally tractable solution to this NP-complete problem.
title Differential Set Selection via Confidence-Guided Entropy Minimization
topic Computation
url https://arxiv.org/abs/2510.27479