Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Tool

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pustet, Milena, Steffen, Elisabeth, Mihaljević, Helena, Stanjek, Grischa, Illies, Yannis
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915379412992000
author Pustet, Milena
Steffen, Elisabeth
Mihaljević, Helena
Stanjek, Grischa
Illies, Yannis
author_facet Pustet, Milena
Steffen, Elisabeth
Mihaljević, Helena
Stanjek, Grischa
Illies, Yannis
contents The role of civil society organizations (CSOs) in monitoring harmful online content is increasingly crucial, especially as platform providers reduce their investment in content moderation. AI tools can assist in detecting and monitoring harmful content at scale. However, few open-source tools offer seamless integration of AI models and social media monitoring infrastructures. Given their thematic expertise and contextual understanding of harmful content, CSOs should be active partners in co-developing technological tools, providing feedback, helping to improve models, and ensuring alignment with stakeholder needs and values, rather than as passive 'consumers'. However, collaborations between the open source community, academia, and civil society remain rare, and research on harmful content seldom translates into practical tools usable by civil society actors. This work in progress explores how CSOs can be meaningfully involved in an AI-assisted open-source monitoring tool of anti-democratic movements on Telegram, which we are currently developing in collaboration with CSO stakeholders.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06734
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Tool
Pustet, Milena
Steffen, Elisabeth
Mihaljević, Helena
Stanjek, Grischa
Illies, Yannis
Human-Computer Interaction
Artificial Intelligence
Computation and Language
Computers and Society
The role of civil society organizations (CSOs) in monitoring harmful online content is increasingly crucial, especially as platform providers reduce their investment in content moderation. AI tools can assist in detecting and monitoring harmful content at scale. However, few open-source tools offer seamless integration of AI models and social media monitoring infrastructures. Given their thematic expertise and contextual understanding of harmful content, CSOs should be active partners in co-developing technological tools, providing feedback, helping to improve models, and ensuring alignment with stakeholder needs and values, rather than as passive 'consumers'. However, collaborations between the open source community, academia, and civil society remain rare, and research on harmful content seldom translates into practical tools usable by civil society actors. This work in progress explores how CSOs can be meaningfully involved in an AI-assisted open-source monitoring tool of anti-democratic movements on Telegram, which we are currently developing in collaboration with CSO stakeholders.
title Civil Society in the Loop: Feedback-Driven Adaptation of (L)LM-Assisted Classification in an Open-Source Telegram Monitoring Tool
topic Human-Computer Interaction
Artificial Intelligence
Computation and Language
Computers and Society
url https://arxiv.org/abs/2507.06734