Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.16264 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911297504804864 |
|---|---|
| author | Lin, Wenjie Liu, Hange Zhuang, Yingying Mao, Xutao Shi, Jingwei Han, Xudong Shi, Tianyu Yang, Jinrui |
| author_facet | Lin, Wenjie Liu, Hange Zhuang, Yingying Mao, Xutao Shi, Jingwei Han, Xudong Shi, Tianyu Yang, Jinrui |
| contents | We present ParlAI Vote, an interactive web platform for exploring European Parliament debates and votes, and for testing LLMs on vote prediction and bias analysis. This web system connects debate topics, speeches, and roll-call outcomes, and includes rich demographic data such as gender, age, country, and political group. Users can browse debates, inspect linked speeches, compare real voting outcomes with predictions from frontier LLMs, and view error breakdowns by demographic group. Visualizing the EuroParlVote benchmark and its core tasks of gender classification and vote prediction, ParlAI Vote highlights systematic performance bias in state-of-the-art LLMs. It unifies data, models, and visual analytics in a single interface, lowering the barrier for reproducing findings, auditing behavior, and running counterfactual scenarios. This web platform also shows model reasoning, helping users see why errors occur and what cues the models rely on. It supports research, education, and public engagement with legislative decision-making, while making clear both the strengths and the limitations of current LLMs in political analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_16264 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ParlAI Vote: A Web Platform for Analyzing Gender and Political Bias in Large Language Models Lin, Wenjie Liu, Hange Zhuang, Yingying Mao, Xutao Shi, Jingwei Han, Xudong Shi, Tianyu Yang, Jinrui Computation and Language Artificial Intelligence Human-Computer Interaction Machine Learning We present ParlAI Vote, an interactive web platform for exploring European Parliament debates and votes, and for testing LLMs on vote prediction and bias analysis. This web system connects debate topics, speeches, and roll-call outcomes, and includes rich demographic data such as gender, age, country, and political group. Users can browse debates, inspect linked speeches, compare real voting outcomes with predictions from frontier LLMs, and view error breakdowns by demographic group. Visualizing the EuroParlVote benchmark and its core tasks of gender classification and vote prediction, ParlAI Vote highlights systematic performance bias in state-of-the-art LLMs. It unifies data, models, and visual analytics in a single interface, lowering the barrier for reproducing findings, auditing behavior, and running counterfactual scenarios. This web platform also shows model reasoning, helping users see why errors occur and what cues the models rely on. It supports research, education, and public engagement with legislative decision-making, while making clear both the strengths and the limitations of current LLMs in political analysis. |
| title | ParlAI Vote: A Web Platform for Analyzing Gender and Political Bias in Large Language Models |
| topic | Computation and Language Artificial Intelligence Human-Computer Interaction Machine Learning |
| url | https://arxiv.org/abs/2509.16264 |