BrightCookies at SemEval-2025 Task 9: Exploring Data Augmentation for Food Hazard Classification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Papadopoulou, Foteini, Mutlu, Osman, Özen, Neris, van der Velden, Bas H. M., Hendrickx, Iris, Hürriyetoğlu, Ali
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912353416642560
author Papadopoulou, Foteini
Mutlu, Osman
Özen, Neris
van der Velden, Bas H. M.
Hendrickx, Iris
Hürriyetoğlu, Ali
author_facet Papadopoulou, Foteini
Mutlu, Osman
Özen, Neris
van der Velden, Bas H. M.
Hendrickx, Iris
Hürriyetoğlu, Ali
contents This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of granularity from food recall incident reports. In this work, we propose text augmentation techniques as a way to improve poor performance on minority classes and compare their effect for each category on various transformer and machine learning models. We explore three word-level data augmentation techniques, namely synonym replacement, random word swapping, and contextual word insertion. The results show that transformer models tend to have a better overall performance. None of the three augmentation techniques consistently improved overall performance for classifying hazards and products. We observed a statistically significant improvement (P < 0.05) in the fine-grained categories when using the BERT model to compare the baseline with each augmented model. Compared to the baseline, the contextual words insertion augmentation improved the accuracy of predictions for the minority hazard classes by 6%. This suggests that targeted augmentation of minority classes can improve the performance of transformer models.
format Preprint
id arxiv_https___arxiv_org_abs_2504_20703
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BrightCookies at SemEval-2025 Task 9: Exploring Data Augmentation for Food Hazard Classification
Papadopoulou, Foteini
Mutlu, Osman
Özen, Neris
van der Velden, Bas H. M.
Hendrickx, Iris
Hürriyetoğlu, Ali
Computation and Language
This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of granularity from food recall incident reports. In this work, we propose text augmentation techniques as a way to improve poor performance on minority classes and compare their effect for each category on various transformer and machine learning models. We explore three word-level data augmentation techniques, namely synonym replacement, random word swapping, and contextual word insertion. The results show that transformer models tend to have a better overall performance. None of the three augmentation techniques consistently improved overall performance for classifying hazards and products. We observed a statistically significant improvement (P < 0.05) in the fine-grained categories when using the BERT model to compare the baseline with each augmented model. Compared to the baseline, the contextual words insertion augmentation improved the accuracy of predictions for the minority hazard classes by 6%. This suggests that targeted augmentation of minority classes can improve the performance of transformer models.
title BrightCookies at SemEval-2025 Task 9: Exploring Data Augmentation for Food Hazard Classification
topic Computation and Language
url https://arxiv.org/abs/2504.20703