Improving Customer Service with Automatic Topic Detection in User Emails

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bašaragin, Bojana, Medvecki, Darija, Gojić, Gorana, Oparnica, Milena, Mišković, Dragiša
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911452511600640
author Bašaragin, Bojana
Medvecki, Darija
Gojić, Gorana
Oparnica, Milena
Mišković, Dragiša
author_facet Bašaragin, Bojana
Medvecki, Darija
Gojić, Gorana
Oparnica, Milena
Mišković, Dragiša
contents This study introduces a novel natural language processing pipeline that enhances customer service efficiency at Telekom Srbija, a leading Serbian telecommunications company, through automated email topic detection and labeling. Central to the pipeline is BERTopic, a modular framework that allows unsupervised topic modeling. After a series of preprocessing and postprocessing steps, we assign one of 12 topics and several additional labels to incoming emails, allowing customer service to filter and access them through a custom-made application. While applied to Serbian, the methodology is conceptually language-agnostic and can be readily adapted to other languages, particularly those that are low-resourced and morphologically rich. The system performance was evaluated by assessing the speed and correctness of the automatically assigned topics, with a weighted average processing time of 0.041 seconds per email and a weighted average F1 score of 0.96. The system now operates in the company's production environment, streamlining customer service operations through automated email classification.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19115
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving Customer Service with Automatic Topic Detection in User Emails
Bašaragin, Bojana
Medvecki, Darija
Gojić, Gorana
Oparnica, Milena
Mišković, Dragiša
Computation and Language
Artificial Intelligence
Machine Learning
This study introduces a novel natural language processing pipeline that enhances customer service efficiency at Telekom Srbija, a leading Serbian telecommunications company, through automated email topic detection and labeling. Central to the pipeline is BERTopic, a modular framework that allows unsupervised topic modeling. After a series of preprocessing and postprocessing steps, we assign one of 12 topics and several additional labels to incoming emails, allowing customer service to filter and access them through a custom-made application. While applied to Serbian, the methodology is conceptually language-agnostic and can be readily adapted to other languages, particularly those that are low-resourced and morphologically rich. The system performance was evaluated by assessing the speed and correctness of the automatically assigned topics, with a weighted average processing time of 0.041 seconds per email and a weighted average F1 score of 0.96. The system now operates in the company's production environment, streamlining customer service operations through automated email classification.
title Improving Customer Service with Automatic Topic Detection in User Emails
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2502.19115