Saved in:
Bibliographic Details
Main Authors: Kurpicz-Briki, Mascha, Merhbene, Ghofrane, Puttick, Alexandre, Souissi, Souhir Ben, Bieri, Jannic, Müller, Thomas Jörg, Golz, Christoph
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.14357
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912040055996416
author Kurpicz-Briki, Mascha
Merhbene, Ghofrane
Puttick, Alexandre
Souissi, Souhir Ben
Bieri, Jannic
Müller, Thomas Jörg
Golz, Christoph
author_facet Kurpicz-Briki, Mascha
Merhbene, Ghofrane
Puttick, Alexandre
Souissi, Souhir Ben
Bieri, Jannic
Müller, Thomas Jörg
Golz, Christoph
contents Burnout, classified as a syndrome in the ICD-11, arises from chronic workplace stress that has not been effectively managed. It is characterized by exhaustion, cynicism, and reduced professional efficacy, and estimates of its prevalence vary significantly due to inconsistent measurement methods. Recent advancements in Natural Language Processing (NLP) and machine learning offer promising tools for detecting burnout through textual data analysis, with studies demonstrating high predictive accuracy. This paper contributes to burnout detection in German texts by: (a) collecting an anonymous real-world dataset including free-text answers and Oldenburg Burnout Inventory (OLBI) responses; (b) demonstrating the limitations of a GermanBERT-based classifier trained on online data; (c) presenting two versions of a curated BurnoutExpressions dataset, which yielded models that perform well in real-world applications; and (d) providing qualitative insights from an interdisciplinary focus group on the interpretability of AI models used for burnout detection. Our findings emphasize the need for greater collaboration between AI researchers and clinical experts to refine burnout detection models. Additionally, more real-world data is essential to validate and enhance the effectiveness of current AI methods developed in NLP research, which are often based on data automatically scraped from online sources and not evaluated in a real-world context. This is essential for ensuring AI tools are well suited for practical applications.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14357
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Using Natural Language Processing to find Indication for Burnout with Text Classification: From Online Data to Real-World Data
Kurpicz-Briki, Mascha
Merhbene, Ghofrane
Puttick, Alexandre
Souissi, Souhir Ben
Bieri, Jannic
Müller, Thomas Jörg
Golz, Christoph
Computation and Language
Machine Learning
Burnout, classified as a syndrome in the ICD-11, arises from chronic workplace stress that has not been effectively managed. It is characterized by exhaustion, cynicism, and reduced professional efficacy, and estimates of its prevalence vary significantly due to inconsistent measurement methods. Recent advancements in Natural Language Processing (NLP) and machine learning offer promising tools for detecting burnout through textual data analysis, with studies demonstrating high predictive accuracy. This paper contributes to burnout detection in German texts by: (a) collecting an anonymous real-world dataset including free-text answers and Oldenburg Burnout Inventory (OLBI) responses; (b) demonstrating the limitations of a GermanBERT-based classifier trained on online data; (c) presenting two versions of a curated BurnoutExpressions dataset, which yielded models that perform well in real-world applications; and (d) providing qualitative insights from an interdisciplinary focus group on the interpretability of AI models used for burnout detection. Our findings emphasize the need for greater collaboration between AI researchers and clinical experts to refine burnout detection models. Additionally, more real-world data is essential to validate and enhance the effectiveness of current AI methods developed in NLP research, which are often based on data automatically scraped from online sources and not evaluated in a real-world context. This is essential for ensuring AI tools are well suited for practical applications.
title Using Natural Language Processing to find Indication for Burnout with Text Classification: From Online Data to Real-World Data
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2409.14357