Cover Image

The CitizenQuery Benchmark: A Novel Dataset and Evaluation Pipeline for Measuring LLM Performance in Citizen Query Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Majithia, Neil, Shinde, Rajat, Chapman, Zo, Trital, Prajun, Decker, Jordan, Maskey, Manil, Simperl, Elena, Shadbolt, Nigel
Format:	Preprint
Published:	2026
Subjects:	Computers and Society
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An actionable framework for AI‐ready data
by: Neil Majithia, et al.
Published: (2026)

Methods to Assess the UK Government's Current Role as a Data Provider for AI
by: Majithia, Neil, et al.
Published: (2024)

WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks
by: Shinde, Rajat, et al.
Published: (2024)

SigSPARQL: Signals as a First-Class Citizen When Querying Knowledge Graphs
by: Schwarzinger, Tobias, et al.
Published: (2025)

A Standardized Machine-readable Dataset Documentation Format for Responsible AI
by: Jain, Nitisha, et al.
Published: (2024)

Citizens' Rights and the Right to Be a Citizen
by: Ballin, Ernst Hirsch
Published: (2025)

"Diversity is Having the Diversity": Unpacking and Designing for Diversity in Applicant Selection
by: Natarajan, Neil, et al.
Published: (2024)

The Exoplanet Citizen Science Pipeline: Human Factors and Machine Learning
by: Creaner, Oisin, et al.
Published: (2024)

Making Prompts First-Class Citizens for Adaptive LLM Pipelines
by: Cetintemel, Ugur, et al.
Published: (2025)

The Exoplanet Citizen Science Pipeline: Human Factors and Machine Learning
by: Creaner, Oisín, et al.
Published: (2025)

WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia
by: Quaremba, Gerrit, et al.
Published: (2025)

The Highest Good in the Nicomachean Ethics and the Bhagavad Gita
by: Majithia, Roopen
Published: (2024)

The Task-oriented Queries Benchmark (ToQB)
by: Yim, Keun Soo
Published: (2024)

Citizen Science
Published: (2018)

Citizen Outsider
by: Beaman, Jean
Published: (2017)

the Citizen's Voice
Published: (2022)

Stranger Citizens
by: O'Keefe, John McNelis
Published: (2021)

Sound Citizens
by: Fisher, Catherine
Published: (2021)

Carceral Citizens
by: Parker, Caroline M.
Published: (2025)

The Playful Citizen
Published: (2019)

Citizen Lobby
by: Thomas Olsen, Leif
Published: (2020)

Savages and Citizens
by: Canessa, Andrew, et al.
Published: (2024)

Citizen Outsider
by: Beaman, Jean
Published: (2020)

Citizens of Photography
Published: (2023)

Citizen labor
by: Nafis Aziz Hasan
Published: (2024)

Cyprus Citizen Service Centers, Citizen Centers and Post offices
by: Abdeldayem, Walid
Published: (2025)

Democratic Values in Citizen Participation: What Citizens Prioritize in Participation
by: Take Sipma, et al.
Published: (2026)

From Sycophantic Consensus to Pluralistic Repair: Why AI Alignment Must Surface Disagreement
by: Vishwarupe, Varad, et al.
Published: (2026)

Investigation into U.S. Citizen and Non-Citizen Worker Health Insurance and Employment
by: Yao, Annabelle
Published: (2025)

User Experience In Dataset Search
by: Zhao, Yihang, et al.
Published: (2024)

Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries
by: Amoroso, Roberto, et al.
Published: (2024)

QueryAdapter: Rapid Adaptation of Vision-Language Models in Response to Natural Language Queries
by: Chapman, Nicolas Harvey, et al.
Published: (2025)

Citizens’ Observatories on Geohazards
Published: (2025)

Civil War Citizens
Published: (2024)

Empowering the Digital Citizen
by: Van Audenhove, Leo, et al.
Published: (2025)

The Meanings of Voting for Citizens
Published: (2025)

Mapping and the Citizen Sensor
Published: (2017)

A Citizen of Yiddishland
by: Nalewajko-Kulikov, Joanna
Published: (2022)

Being Digital Citizens
by: Isin, Engin, et al.
Published: (2026)

Consumer-Citizens of China
by: Tian, Kelly, et al.
Published: (2025)