MimiTalk: Revolutionizing Qualitative Research with Dual-Agent AI

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Fengming, Yu, Shubin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915601464688640
author Liu, Fengming
Yu, Shubin
author_facet Liu, Fengming
Yu, Shubin
contents We present MimiTalk, a dual-agent constitutional AI framework designed for scalable and ethical conversational data collection in social science research. The framework integrates a supervisor model for strategic oversight and a conversational model for question generation. We conducted three studies: Study 1 evaluated usability with 20 participants; Study 2 compared 121 AI interviews to 1,271 human interviews from the MediaSum dataset using NLP metrics and propensity score matching; Study 3 involved 10 interdisciplinary researchers conducting both human and AI interviews, followed by blind thematic analysis. Results across studies indicate that MimiTalk reduces interview anxiety, maintains conversational coherence, and outperforms human interviews in information richness, coherence, and stability. AI interviews elicit technical insights and candid views on sensitive topics, while human interviews better capture cultural and emotional nuances. These findings suggest that dual-agent constitutional AI supports effective human-AI collaboration, enabling replicable, scalable and quality-controlled qualitative research.
format Preprint
id arxiv_https___arxiv_org_abs_2511_03731
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MimiTalk: Revolutionizing Qualitative Research with Dual-Agent AI
Liu, Fengming
Yu, Shubin
Human-Computer Interaction
Artificial Intelligence
Computation and Language
We present MimiTalk, a dual-agent constitutional AI framework designed for scalable and ethical conversational data collection in social science research. The framework integrates a supervisor model for strategic oversight and a conversational model for question generation. We conducted three studies: Study 1 evaluated usability with 20 participants; Study 2 compared 121 AI interviews to 1,271 human interviews from the MediaSum dataset using NLP metrics and propensity score matching; Study 3 involved 10 interdisciplinary researchers conducting both human and AI interviews, followed by blind thematic analysis. Results across studies indicate that MimiTalk reduces interview anxiety, maintains conversational coherence, and outperforms human interviews in information richness, coherence, and stability. AI interviews elicit technical insights and candid views on sensitive topics, while human interviews better capture cultural and emotional nuances. These findings suggest that dual-agent constitutional AI supports effective human-AI collaboration, enabling replicable, scalable and quality-controlled qualitative research.
title MimiTalk: Revolutionizing Qualitative Research with Dual-Agent AI
topic Human-Computer Interaction
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2511.03731