Cover Image

SubData: Bridging Heterogeneous Datasets to Enable Theory-Driven Evaluation of Political and Demographic Perspectives in LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bernardelle, Pietro, Fröhling, Leon, Civelli, Stefano, Demartini, Gianluca
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Impact of Persona-based Political Perspectives on Hateful Content Detection
by: Civelli, Stefano, et al.
Published: (2025)

Political Ideology Shifts in Large Language Models
by: Bernardelle, Pietro, et al.
Published: (2025)

Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personas
by: Bernardelle, Pietro, et al.
Published: (2024)

Context Shapes LLMs Retrieval-Augmented Fact-Checking Effectiveness
by: Bernardelle, Pietro, et al.
Published: (2026)

Ideology-Based LLMs for Content Moderation
by: Civelli, Stefano, et al.
Published: (2025)

A Shared Geometry of Difficulty in Multilingual Language Models
by: Civelli, Stefano, et al.
Published: (2026)

Political Advertising on Facebook During the 2022 Australian Federal Election: A Social Identity Perspective
by: Civelli, Stefano, et al.
Published: (2025)

Personas with Attitudes: Controlling LLMs for Diverse Data Annotation
by: Fröhling, Leon, et al.
Published: (2024)

Towards Detecting Persuasion on Social Media: From Model Development to Insights on Persuasion Strategies
by: Meguellati, Elyas, et al.
Published: (2025)

Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective
by: Bernardelle, Pietro, et al.
Published: (2024)

LLM-Generated Ads: From Personalization Parity to Persuasion Superiority
by: Meguellati, Elyas, et al.
Published: (2025)

MiningGPT -- A Domain-Specific Large Language Model for the Mining Industry
by: Demartini, Kurukulasooriya Fernando ana Gianluca
Published: (2024)

Are Large Language Models Good Data Preprocessors?
by: Meguellati, Elyas, et al.
Published: (2025)

Query-Document Dense Vectors for LLM Relevance Judgment Bias Analysis
by: Mohtadi, Samaneh, et al.
Published: (2026)

Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges
by: Ariai, Farid, et al.
Published: (2024)

The Effect of Document Summarization on LLM-Based Relevance Judgments
by: Mohtadi, Samaneh, et al.
Published: (2025)

Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant
by: He, Gaole, et al.
Published: (2025)

LLM-based Semantic Augmentation for Harmful Content Detection
by: Meguellati, Elyas, et al.
Published: (2025)

German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
by: Rupprecht, Jens, et al.
Published: (2025)

The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasets
by: Yu, Zehui, et al.
Published: (2024)

Leveraging Semantic Type Dependencies for Clinical Named Entity Recognition
by: Le, Linh, et al.
Published: (2025)

Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theory
by: Smith-Vaniz, Nicole, et al.
Published: (2025)

Beyond Marginal Distributions: A Framework to Evaluate the Representativeness of Demographic-Aligned LLMs
by: Williams, Tristan, et al.
Published: (2026)

Identification of Regulatory Requirements Relevant to Business Processes: A Comparative Study on Generative AI, Embedding-based Ranking, Crowd and Expert-driven Methods
by: Sai, Catherine, et al.
Published: (2024)

Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Concepts
by: Halterman, Andrew, et al.
Published: (2024)

On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey
by: Long, Lin, et al.
Published: (2024)

Modeling Human Perspectives with Socio-Demographic Representations
by: Zhang, Leixin, et al.
Published: (2026)

Elucidating Mechanisms of Demographic Bias in LLMs for Healthcare
by: Ahsan, Hiba, et al.
Published: (2025)

Unpacking Human Preference for LLMs: Demographically Aware Evaluation with the HUMAINE Framework
by: Petrova, Nora, et al.
Published: (2026)

Hate Speech Detection with Generalizable Target-aware Fairness
by: Chen, Tong, et al.
Published: (2024)

Benchmarking LLMs for Political Science: A United Nations Perspective
by: Liang, Yueqing, et al.
Published: (2025)

Which Demographics do LLMs Default to During Annotation?
by: Schäfer, Johannes, et al.
Published: (2024)

LLMs in Education: Novel Perspectives, Challenges, and Opportunities
by: Alhafni, Bashar, et al.
Published: (2024)

Opportunities and Challenges of LLMs in Education: An NLP Perspective
by: Vajjala, Sowmya, et al.
Published: (2025)

Evaluating LLMs for Demographic-Targeted Social Bias Detection: A Comprehensive Benchmark Study
by: Majumdar, Ayan, et al.
Published: (2025)

When Does Demographic Information Help? Data and Modeling Regimes for Perspective-Aware Hate Speech Detection
by: Cai, Weibin, et al.
Published: (2026)

Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies
by: Liu, Terrance, et al.
Published: (2025)

Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic Perspectives
by: Xu, Yinuo, et al.
Published: (2025)

Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness
by: Alipour, Shayan, et al.
Published: (2024)

Assessing the Reliability of LLMs Annotations in the Context of Demographic Bias and Model Explanation
by: Mohammadi, Hadi, et al.
Published: (2025)