Saved in:
Bibliographic Details
Main Authors: Vargas, Víctor Manuel, Gutiérrez, Pedro Antonio, Barbero-Gómez, Javier, Hervás-Martínez, César
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.12417
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911958094053376
author Vargas, Víctor Manuel
Gutiérrez, Pedro Antonio
Barbero-Gómez, Javier
Hervás-Martínez, César
author_facet Vargas, Víctor Manuel
Gutiérrez, Pedro Antonio
Barbero-Gómez, Javier
Hervás-Martínez, César
contents An ordinal classification problem is one in which the target variable takes values on an ordinal scale. Nowadays, there are many of these problems associated with real-world tasks where it is crucial to accurately classify the extreme classes of the ordinal structure. In this work, we propose a unimodal regularisation approach that can be applied to any loss function to improve the classification performance of the first and last classes while maintaining good performance for the remainder. The proposed methodology is tested on six datasets with different numbers of classes, and compared with other unimodal regularisation methods in the literature. In addition, performance in the extreme classes is compared using a new metric that takes into account their sensitivities. Experimental results and statistical analysis show that the proposed methodology obtains a superior average performance considering different metrics. The results for the proposed metric show that the generalised beta distribution generally improves classification performance in the extreme classes. At the same time, the other five nominal and ordinal metrics considered show that the overall performance is aligned with the performance of previous alternatives.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12417
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving the classification of extreme classes by means of loss regularisation and generalised beta distributions
Vargas, Víctor Manuel
Gutiérrez, Pedro Antonio
Barbero-Gómez, Javier
Hervás-Martínez, César
Machine Learning
Artificial Intelligence
An ordinal classification problem is one in which the target variable takes values on an ordinal scale. Nowadays, there are many of these problems associated with real-world tasks where it is crucial to accurately classify the extreme classes of the ordinal structure. In this work, we propose a unimodal regularisation approach that can be applied to any loss function to improve the classification performance of the first and last classes while maintaining good performance for the remainder. The proposed methodology is tested on six datasets with different numbers of classes, and compared with other unimodal regularisation methods in the literature. In addition, performance in the extreme classes is compared using a new metric that takes into account their sensitivities. Experimental results and statistical analysis show that the proposed methodology obtains a superior average performance considering different metrics. The results for the proposed metric show that the generalised beta distribution generally improves classification performance in the extreme classes. At the same time, the other five nominal and ordinal metrics considered show that the overall performance is aligned with the performance of previous alternatives.
title Improving the classification of extreme classes by means of loss regularisation and generalised beta distributions
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2407.12417