Data Science Kitchen at GermEval 2021: A Fine Selection of Hand-Picked Features, Delivered Fresh from the Oven

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hildebrandt, Niclas, Boenninghoff, Benedikt, Orth, Dennis, Schymura, Christopher
Formato: Preprint
Publicado: 2021
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914914214346752
author Hildebrandt, Niclas
Boenninghoff, Benedikt
Orth, Dennis
Schymura, Christopher
author_facet Hildebrandt, Niclas
Boenninghoff, Benedikt
Orth, Dennis
Schymura, Christopher
contents This paper presents the contribution of the Data Science Kitchen at GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments. The task aims at extending the identification of offensive language, by including additional subtasks that identify comments which should be prioritized for fact-checking by moderators and community managers. Our contribution focuses on a feature-engineering approach with a conventional classification backend. We combine semantic and writing style embeddings derived from pre-trained deep neural networks with additional numerical features, specifically designed for this task. Classifier ensembles are used to derive predictions for each subtask via a majority voting scheme. Our best submission achieved macro-averaged F1-scores of 66.8\%,\,69.9\% and 72.5\% for the identification of toxic, engaging, and fact-claiming comments.
format Preprint
id arxiv_https___arxiv_org_abs_2109_02383
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Data Science Kitchen at GermEval 2021: A Fine Selection of Hand-Picked Features, Delivered Fresh from the Oven
Hildebrandt, Niclas
Boenninghoff, Benedikt
Orth, Dennis
Schymura, Christopher
Computation and Language
Artificial Intelligence
Machine Learning
This paper presents the contribution of the Data Science Kitchen at GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments. The task aims at extending the identification of offensive language, by including additional subtasks that identify comments which should be prioritized for fact-checking by moderators and community managers. Our contribution focuses on a feature-engineering approach with a conventional classification backend. We combine semantic and writing style embeddings derived from pre-trained deep neural networks with additional numerical features, specifically designed for this task. Classifier ensembles are used to derive predictions for each subtask via a majority voting scheme. Our best submission achieved macro-averaged F1-scores of 66.8\%,\,69.9\% and 72.5\% for the identification of toxic, engaging, and fact-claiming comments.
title Data Science Kitchen at GermEval 2021: A Fine Selection of Hand-Picked Features, Delivered Fresh from the Oven
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2109.02383