Should We Always Train Models on Fine-Grained Classes?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918136358371328 |
|---|---|
| author | Pirovano, Davide Milanesio, Federico Caselle, Michele Fariselli, Piero Osella, Matteo |
| author_facet | Pirovano, Davide Milanesio, Federico Caselle, Michele Fariselli, Piero Osella, Matteo |
| contents | In classification problems, models must predict a class label based on the input data features. However, class labels are organized hierarchically in many datasets. While a classification task is often defined at a specific level of this hierarchy, training can utilize a finer granularity of labels. Empirical evidence suggests that such fine-grained training can enhance performance. In this work, we investigate the generality of this observation and explore its underlying causes using both real and synthetic datasets. We show that training on fine-grained labels does not universally improve classification accuracy. Instead, the effectiveness of this strategy depends critically on the geometric structure of the data and its relations with the label hierarchy. Additionally, factors such as dataset size and model capacity significantly influence whether fine-grained labels provide a performance benefit. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_05130 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Should We Always Train Models on Fine-Grained Classes? Pirovano, Davide Milanesio, Federico Caselle, Michele Fariselli, Piero Osella, Matteo Machine Learning In classification problems, models must predict a class label based on the input data features. However, class labels are organized hierarchically in many datasets. While a classification task is often defined at a specific level of this hierarchy, training can utilize a finer granularity of labels. Empirical evidence suggests that such fine-grained training can enhance performance. In this work, we investigate the generality of this observation and explore its underlying causes using both real and synthetic datasets. We show that training on fine-grained labels does not universally improve classification accuracy. Instead, the effectiveness of this strategy depends critically on the geometric structure of the data and its relations with the label hierarchy. Additionally, factors such as dataset size and model capacity significantly influence whether fine-grained labels provide a performance benefit. |
| title | Should We Always Train Models on Fine-Grained Classes? |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2509.05130 |