Automating the Information Extraction from Semi-Structured Interview Transcripts

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: Parfenova, Angelina
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917608180154368
author Parfenova, Angelina
author_facet Parfenova, Angelina
contents This paper explores the development and application of an automated system designed to extract information from semi-structured interview transcripts. Given the labor-intensive nature of traditional qualitative analysis methods, such as coding, there exists a significant demand for tools that can facilitate the analysis process. Our research investigates various topic modeling techniques and concludes that the best model for analyzing interview texts is a combination of BERT embeddings and HDBSCAN clustering. We present a user-friendly software prototype that enables researchers, including those without programming skills, to efficiently process and visualize the thematic structure of interview data. This tool not only facilitates the initial stages of qualitative analysis but also offers insights into the interconnectedness of topics revealed, thereby enhancing the depth of qualitative analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2403_04819
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automating the Information Extraction from Semi-Structured Interview Transcripts
Parfenova, Angelina
Computation and Language
Computers and Society
Information Retrieval
Social and Information Networks
This paper explores the development and application of an automated system designed to extract information from semi-structured interview transcripts. Given the labor-intensive nature of traditional qualitative analysis methods, such as coding, there exists a significant demand for tools that can facilitate the analysis process. Our research investigates various topic modeling techniques and concludes that the best model for analyzing interview texts is a combination of BERT embeddings and HDBSCAN clustering. We present a user-friendly software prototype that enables researchers, including those without programming skills, to efficiently process and visualize the thematic structure of interview data. This tool not only facilitates the initial stages of qualitative analysis but also offers insights into the interconnectedness of topics revealed, thereby enhancing the depth of qualitative analysis.
title Automating the Information Extraction from Semi-Structured Interview Transcripts
topic Computation and Language
Computers and Society
Information Retrieval
Social and Information Networks
url https://arxiv.org/abs/2403.04819