Bridging the Gap: Leveraging Retrieval-Augmented Generation to Better Understand Public Concerns about Vaccines

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Javed, Muhammad, Habibabadi, Sedigh Khademi, Palmer, Christopher, Clothier, Hazel, Buttery, Jim, Dimaguila, Gerardo Luis
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912488376762368
author Javed, Muhammad
Habibabadi, Sedigh Khademi
Palmer, Christopher
Clothier, Hazel
Buttery, Jim
Dimaguila, Gerardo Luis
author_facet Javed, Muhammad
Habibabadi, Sedigh Khademi
Palmer, Christopher
Clothier, Hazel
Buttery, Jim
Dimaguila, Gerardo Luis
contents Vaccine hesitancy threatens public health, leading to delayed or rejected vaccines. Social media is a vital source for understanding public concerns, and traditional methods like topic modelling often struggle to capture nuanced opinions. Though trained for query answering, large Language Models (LLMs) often miss current events and community concerns. Additionally, hallucinations in LLMs can compromise public health communication. To address these limitations, we developed a tool (VaxPulse Query Corner) using the Retrieval Augmented Generation technique. It addresses complex queries about public vaccine concerns on various online platforms, aiding public health administrators and stakeholders in understanding public concerns and implementing targeted interventions to boost vaccine confidence. Analysing 35,103 Shingrix social media posts, it achieved answer faithfulness (0.96) and relevance (0.94).
format Preprint
id arxiv_https___arxiv_org_abs_2507_12840
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging the Gap: Leveraging Retrieval-Augmented Generation to Better Understand Public Concerns about Vaccines
Javed, Muhammad
Habibabadi, Sedigh Khademi
Palmer, Christopher
Clothier, Hazel
Buttery, Jim
Dimaguila, Gerardo Luis
Information Retrieval
Machine Learning
Social and Information Networks
Vaccine hesitancy threatens public health, leading to delayed or rejected vaccines. Social media is a vital source for understanding public concerns, and traditional methods like topic modelling often struggle to capture nuanced opinions. Though trained for query answering, large Language Models (LLMs) often miss current events and community concerns. Additionally, hallucinations in LLMs can compromise public health communication. To address these limitations, we developed a tool (VaxPulse Query Corner) using the Retrieval Augmented Generation technique. It addresses complex queries about public vaccine concerns on various online platforms, aiding public health administrators and stakeholders in understanding public concerns and implementing targeted interventions to boost vaccine confidence. Analysing 35,103 Shingrix social media posts, it achieved answer faithfulness (0.96) and relevance (0.94).
title Bridging the Gap: Leveraging Retrieval-Augmented Generation to Better Understand Public Concerns about Vaccines
topic Information Retrieval
Machine Learning
Social and Information Networks
url https://arxiv.org/abs/2507.12840