Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Free
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914278675578880 |
|---|---|
| author | Bertalis, Nerijus Granse, Paul Gül, Ferhat Hauss, Florian Menkel, Leon Schüler, David Speier, Tom Galke, Lukas Scherp, Ansgar |
| author_facet | Bertalis, Nerijus Granse, Paul Gül, Ferhat Hauss, Florian Menkel, Leon Schüler, David Speier, Tom Galke, Lukas Scherp, Ansgar |
| contents | Assigning a set of labels to a given text is a classification problem with many real-world applications, such as recommender systems. Two separate research streams address this issue. Hierarchical Text Classification (HTC) focuses on datasets with label pools of hundreds of entries, accompanied by a semantic label hierarchy. In contrast, eXtreme Multi-Label Text Classification (XML) considers very large sets of labels with up to millions of entries but without an explicit hierarchy. In XML methods, it is common to construct an artificial hierarchy in order to deal with the large label space before or during the training process. Here, we investigate how state-of-the-art HTC models perform when trained and tested on XML datasets and vice versa using three benchmark datasets from each of the two streams. Our results demonstrate that XML models, with their internally constructed hierarchy, are very effective HTC models. HTC models, on the other hand, are not equipped to handle the sheer label set size of XML datasets and achieve poor transfer results. We further argue that for a fair comparison in HTC and XML, more than one metric like F1 should be used but complemented with P@k and R-Precision. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_13687 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Free Bertalis, Nerijus Granse, Paul Gül, Ferhat Hauss, Florian Menkel, Leon Schüler, David Speier, Tom Galke, Lukas Scherp, Ansgar Computation and Language Assigning a set of labels to a given text is a classification problem with many real-world applications, such as recommender systems. Two separate research streams address this issue. Hierarchical Text Classification (HTC) focuses on datasets with label pools of hundreds of entries, accompanied by a semantic label hierarchy. In contrast, eXtreme Multi-Label Text Classification (XML) considers very large sets of labels with up to millions of entries but without an explicit hierarchy. In XML methods, it is common to construct an artificial hierarchy in order to deal with the large label space before or during the training process. Here, we investigate how state-of-the-art HTC models perform when trained and tested on XML datasets and vice versa using three benchmark datasets from each of the two streams. Our results demonstrate that XML models, with their internally constructed hierarchy, are very effective HTC models. HTC models, on the other hand, are not equipped to handle the sheer label set size of XML datasets and achieve poor transfer results. We further argue that for a fair comparison in HTC and XML, more than one metric like F1 should be used but complemented with P@k and R-Precision. |
| title | Your Extreme Multi-label Classifier is Secretly a Hierarchical Text Classifier for Free |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2411.13687 |