Discriminative Subspace Emersion from learning feature relevances across different populations
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910901414658048 |
|---|---|
| author | Canducci, Marco Abdi, Lida Prete, Alessandro Veen, Roland J. Biehl, Michael Arlt, Wiebke Tino, Peter |
| author_facet | Canducci, Marco Abdi, Lida Prete, Alessandro Veen, Roland J. Biehl, Michael Arlt, Wiebke Tino, Peter |
| contents | In a given classification task, the accuracy of the learner is often hampered by finiteness of the training set, high-dimensionality of the feature space and severe overlap between classes. In the context of interpretable learners, with (piecewise) linear separation boundaries, these issues can be mitigated by careful construction of optimization procedures and/or estimation of relevant features for the task. However, when the task is shared across two disjoint populations the main interest is shifted towards estimating a set of features that discriminate the most between the two, when performing classification. We propose a new Discriminative Subspace Emersion (DSE) method to extend subspace learning toward a general relevance learning framework. DSE allows us to identify the most relevant features in distinguishing the classification task across two populations, even in cases of high overlap between classes. The proposed methodology is designed to work with multiple sets of labels and is derived in principle without being tied to a specific choice of base learner. Theoretical and empirical investigations over synthetic and real-world datasets indicate that DSE accurately identifies a common subspace for the classification across different populations. This is shown to be true for a surprisingly high degree of overlap between classes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_00176 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Discriminative Subspace Emersion from learning feature relevances across different populations Canducci, Marco Abdi, Lida Prete, Alessandro Veen, Roland J. Biehl, Michael Arlt, Wiebke Tino, Peter Machine Learning 68, 92 I.2.1; I.5.2; I.5.5; J.3 In a given classification task, the accuracy of the learner is often hampered by finiteness of the training set, high-dimensionality of the feature space and severe overlap between classes. In the context of interpretable learners, with (piecewise) linear separation boundaries, these issues can be mitigated by careful construction of optimization procedures and/or estimation of relevant features for the task. However, when the task is shared across two disjoint populations the main interest is shifted towards estimating a set of features that discriminate the most between the two, when performing classification. We propose a new Discriminative Subspace Emersion (DSE) method to extend subspace learning toward a general relevance learning framework. DSE allows us to identify the most relevant features in distinguishing the classification task across two populations, even in cases of high overlap between classes. The proposed methodology is designed to work with multiple sets of labels and is derived in principle without being tied to a specific choice of base learner. Theoretical and empirical investigations over synthetic and real-world datasets indicate that DSE accurately identifies a common subspace for the classification across different populations. This is shown to be true for a surprisingly high degree of overlap between classes. |
| title | Discriminative Subspace Emersion from learning feature relevances across different populations |
| topic | Machine Learning 68, 92 I.2.1; I.5.2; I.5.5; J.3 |
| url | https://arxiv.org/abs/2504.00176 |