PolicyPulse: LLM-Synthesis Tool for Policy Researchers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Maggie, Colby, Ella, Okwara, Jennifer, Rao, Varun Nagaraj, Liu, Yuhan, Monroy-Hernández, Andrés
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912403683278848
author Wang, Maggie
Colby, Ella
Okwara, Jennifer
Rao, Varun Nagaraj
Liu, Yuhan
Monroy-Hernández, Andrés
author_facet Wang, Maggie
Colby, Ella
Okwara, Jennifer
Rao, Varun Nagaraj
Liu, Yuhan
Monroy-Hernández, Andrés
contents Public opinion shapes policy, yet capturing it effectively to surface diverse perspectives remains challenging. This paper introduces PolicyPulse, an LLM-powered interactive system that synthesizes public experiences from online community discussions to help policy researchers author memos and briefs, leveraging curated real-world anecdotes. Given a specific topic (e.g., "Climate Change"), PolicyPulse returns an organized list of themes (e.g., "Biodiversity Loss" or "Carbon Pricing"), supporting each theme with relevant quotes from real-life anecdotes. We compared PolicyPulse outputs to authoritative policy reports. Additionally, we asked 11 policy researchers across multiple institutions in the Northeastern U.S to compare using PolicyPulse with their expert approach. We found that PolicyPulse's themes aligned with authoritative reports and helped spark research by analyzing existing data, gathering diverse experiences, revealing unexpected themes, and informing survey or interview design. Participants also highlighted limitations including insufficient demographic context and data verification challenges. Our work demonstrates how AI-powered tools can help influence policy-relevant research and shape policy outcomes.
format Preprint
id arxiv_https___arxiv_org_abs_2505_23994
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PolicyPulse: LLM-Synthesis Tool for Policy Researchers
Wang, Maggie
Colby, Ella
Okwara, Jennifer
Rao, Varun Nagaraj
Liu, Yuhan
Monroy-Hernández, Andrés
Human-Computer Interaction
Public opinion shapes policy, yet capturing it effectively to surface diverse perspectives remains challenging. This paper introduces PolicyPulse, an LLM-powered interactive system that synthesizes public experiences from online community discussions to help policy researchers author memos and briefs, leveraging curated real-world anecdotes. Given a specific topic (e.g., "Climate Change"), PolicyPulse returns an organized list of themes (e.g., "Biodiversity Loss" or "Carbon Pricing"), supporting each theme with relevant quotes from real-life anecdotes. We compared PolicyPulse outputs to authoritative policy reports. Additionally, we asked 11 policy researchers across multiple institutions in the Northeastern U.S to compare using PolicyPulse with their expert approach. We found that PolicyPulse's themes aligned with authoritative reports and helped spark research by analyzing existing data, gathering diverse experiences, revealing unexpected themes, and informing survey or interview design. Participants also highlighted limitations including insufficient demographic context and data verification challenges. Our work demonstrates how AI-powered tools can help influence policy-relevant research and shape policy outcomes.
title PolicyPulse: LLM-Synthesis Tool for Policy Researchers
topic Human-Computer Interaction
url https://arxiv.org/abs/2505.23994