Saved in:
Bibliographic Details
Main Authors: Pizard, Sebastián, Moreira, Ramiro, Galiano, Federico, Sastre, Ignacio, Etcheverry, Lorena
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.16502
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911219678445568
author Pizard, Sebastián
Moreira, Ramiro
Galiano, Federico
Sastre, Ignacio
Etcheverry, Lorena
author_facet Pizard, Sebastián
Moreira, Ramiro
Galiano, Federico
Sastre, Ignacio
Etcheverry, Lorena
contents Large language models (LLMs) show promise for supporting systematic reviews (SR), even complex tasks such as qualitative synthesis (QS). However, applying them to a stage that is unevenly reported and variably conducted carries important risks: misuse can amplify existing weaknesses and erode confidence in the SR findings. To examine the challenges of using LLMs for QS, we conducted a collaborative autoethnography involving two trials. We evaluated each trial for methodological rigor and practical usefulness, and interpreted the results through a technical lens informed by how LLMs are built and their current limitations.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16502
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On the Use of Large Language Models for Qualitative Synthesis
Pizard, Sebastián
Moreira, Ramiro
Galiano, Federico
Sastre, Ignacio
Etcheverry, Lorena
Software Engineering
Large language models (LLMs) show promise for supporting systematic reviews (SR), even complex tasks such as qualitative synthesis (QS). However, applying them to a stage that is unevenly reported and variably conducted carries important risks: misuse can amplify existing weaknesses and erode confidence in the SR findings. To examine the challenges of using LLMs for QS, we conducted a collaborative autoethnography involving two trials. We evaluated each trial for methodological rigor and practical usefulness, and interpreted the results through a technical lens informed by how LLMs are built and their current limitations.
title On the Use of Large Language Models for Qualitative Synthesis
topic Software Engineering
url https://arxiv.org/abs/2510.16502