Confidence Calibration of Classifiers with Many Classes
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912106794713088 |
|---|---|
| author | LeCoz, Adrien Herbin, Stéphane Adjed, Faouzi |
| author_facet | LeCoz, Adrien Herbin, Stéphane Adjed, Faouzi |
| contents | For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing calibration step. However, many confidence calibration methods fail for problems with many classes. To address this issue, we transform the problem of calibrating a multiclass classifier into calibrating a single surrogate binary classifier. This approach allows for more efficient use of standard calibration methods. We evaluate our approach on numerous neural networks used for image or text classification and show that it significantly enhances existing calibration methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_02988 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Confidence Calibration of Classifiers with Many Classes LeCoz, Adrien Herbin, Stéphane Adjed, Faouzi Machine Learning Artificial Intelligence For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing calibration step. However, many confidence calibration methods fail for problems with many classes. To address this issue, we transform the problem of calibrating a multiclass classifier into calibrating a single surrogate binary classifier. This approach allows for more efficient use of standard calibration methods. We evaluate our approach on numerous neural networks used for image or text classification and show that it significantly enhances existing calibration methods. |
| title | Confidence Calibration of Classifiers with Many Classes |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2411.02988 |