Zero-Shot Hierarchical Classification on the Common Procurement Vocabulary Taxonomy

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Moiraghi, Federico, Palmonari, Matteo, Allavena, Davide, Morando, Federico
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913369760464896
author Moiraghi, Federico
Palmonari, Matteo
Allavena, Davide
Morando, Federico
author_facet Moiraghi, Federico
Palmonari, Matteo
Allavena, Davide
Morando, Federico
contents Classifying public tenders is a useful task for both companies that are invited to participate and for inspecting fraudulent activities. To facilitate the task for both participants and public administrations, the European Union presented a common taxonomy (Common Procurement Vocabulary, CPV) which is mandatory for tenders of certain importance; however, the contracts in which a CPV label is mandatory are the minority compared to all the Public Administrations activities. Classifying over a real-world taxonomy introduces some difficulties that can not be ignored. First of all, some fine-grained classes have an insufficient (if any) number of observations in the training set, while other classes are far more frequent (even thousands of times) than the average. To overcome those difficulties, we present a zero-shot approach, based on a pre-trained language model that relies only on label description and respects the label taxonomy. To train our proposed model, we used industrial data, which comes from contrattipubblici.org, a service by SpazioDati s.r.l. that collects public contracts stipulated in Italy in the last 25 years. Results show that the proposed model achieves better performance in classifying low-frequent classes compared to three different baselines, and is also able to predict never-seen classes.
format Preprint
id arxiv_https___arxiv_org_abs_2405_09983
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Zero-Shot Hierarchical Classification on the Common Procurement Vocabulary Taxonomy
Moiraghi, Federico
Palmonari, Matteo
Allavena, Davide
Morando, Federico
Machine Learning
Computation and Language
Classifying public tenders is a useful task for both companies that are invited to participate and for inspecting fraudulent activities. To facilitate the task for both participants and public administrations, the European Union presented a common taxonomy (Common Procurement Vocabulary, CPV) which is mandatory for tenders of certain importance; however, the contracts in which a CPV label is mandatory are the minority compared to all the Public Administrations activities. Classifying over a real-world taxonomy introduces some difficulties that can not be ignored. First of all, some fine-grained classes have an insufficient (if any) number of observations in the training set, while other classes are far more frequent (even thousands of times) than the average. To overcome those difficulties, we present a zero-shot approach, based on a pre-trained language model that relies only on label description and respects the label taxonomy. To train our proposed model, we used industrial data, which comes from contrattipubblici.org, a service by SpazioDati s.r.l. that collects public contracts stipulated in Italy in the last 25 years. Results show that the proposed model achieves better performance in classifying low-frequent classes compared to three different baselines, and is also able to predict never-seen classes.
title Zero-Shot Hierarchical Classification on the Common Procurement Vocabulary Taxonomy
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2405.09983