Copertina

PakBBQ: A Culturally Adapted Bias Benchmark for QA

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hashmat, Abdullah, Mirza, Muhammad Arham, Raza, Agha Ali
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence Computers and Society Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

GG-BBQ: German Gender Bias Benchmark for Question Answering
di: Satheesh, Shalaka, et al.
Pubblicazione: (2025)

BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responses
di: Xu, Xin, et al.
Pubblicazione: (2025)

Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models
di: Kumar, Abhishek, et al.
Pubblicazione: (2024)

Mitigating Bias for Question Answering Models by Tracking Bias Influence
di: Ma, Mingyu Derek, et al.
Pubblicazione: (2023)

No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languages
di: Mohamed, Youssef, et al.
Pubblicazione: (2024)

Bias and Fairness in Large Language Models: A Survey
di: Gallegos, Isabel O., et al.
Pubblicazione: (2023)

KoBBQ: Korean Bias Benchmark for Question Answering
di: Jin, Jiho, et al.
Pubblicazione: (2023)

Breaking Down Bias: On The Limits of Generalizable Pruning Strategies
di: Ma, Sibo, et al.
Pubblicazione: (2025)

Impacts of Racial Bias in Historical Training Data for News AI
di: Bhargava, Rahul, et al.
Pubblicazione: (2025)

BiasEdit: Debiasing Stereotyped Language Models via Model Editing
di: Xu, Xin, et al.
Pubblicazione: (2025)

LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases
di: Bouchard, Dylan, et al.
Pubblicazione: (2025)

Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model
di: Lifelo, Zita, et al.
Pubblicazione: (2024)

UQA: Corpus for Urdu Question Answering
di: Arif, Samee, et al.
Pubblicazione: (2024)

What's in a Name? Auditing Large Language Models for Race and Gender Bias
di: Salinas, Alejandro, et al.
Pubblicazione: (2024)

Toward Inclusive Educational AI: Auditing Frontier LLMs through a Multiplexity Lens
di: Mushtaq, Abdullah, et al.
Pubblicazione: (2025)

Contextual StereoSet: Stress-Testing Bias Alignment Robustness in Large Language Models
di: Basu, Abhinaba, et al.
Pubblicazione: (2026)

Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text
di: Islam, Tunazzina
Pubblicazione: (2026)

How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses
di: Urchs, Stefanie, et al.
Pubblicazione: (2023)

AI-AI Bias: large language models favor communications generated by large language models
di: Laurito, Walter, et al.
Pubblicazione: (2024)

Retrieval Improvements Do Not Guarantee Better Answers: A Study of RAG for AI Policy QA
di: Mathur, Saahil, et al.
Pubblicazione: (2026)

AWARE, Beyond Sentence Boundaries: A Contextual Transformer Framework for Identifying Cultural Capital in STEM Narratives
di: Khan, Khalid Mehtab, et al.
Pubblicazione: (2025)

GECOBench: A Gender-Controlled Text Dataset and Benchmark for Quantifying Biases in Explanations
di: Wilming, Rick, et al.
Pubblicazione: (2024)

Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?
di: Jinnai, Yuu
Pubblicazione: (2024)

The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning
di: Li, Nathaniel, et al.
Pubblicazione: (2024)

Sentiment Analysis of Airbnb Reviews: Exploring Their Impact on Acceptance Rates and Pricing Across Multiple U.S. Regions
di: Safari, Ali
Pubblicazione: (2025)

Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook
di: Lee, Jaehyeok, et al.
Pubblicazione: (2026)

HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generation
di: Liu, Haokun, et al.
Pubblicazione: (2025)

Benchmarking the Legal Reasoning of LLMs in Arabic Islamic Inheritance Cases
di: AlDahoul, Nouar, et al.
Pubblicazione: (2025)

The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems
di: Ren, Richard, et al.
Pubblicazione: (2025)

COMPL-AI Framework: A Technical Interpretation and LLM Benchmarking Suite for the EU Artificial Intelligence Act
di: Guldimann, Philipp, et al.
Pubblicazione: (2024)

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?
di: Ren, Richard, et al.
Pubblicazione: (2024)

MateInfoUB: A Real-World Benchmark for Testing LLMs in Competitive, Multilingual, and Multimodal Educational Tasks
di: Marius, Dumitran Adrian, et al.
Pubblicazione: (2025)

SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
di: Hu, Tiancheng, et al.
Pubblicazione: (2025)

Towards Large Language Models that Benefit for All: Benchmarking Group Fairness in Reward Models
di: Song, Kefan, et al.
Pubblicazione: (2025)

NoisyHate: Mining Online Human-Written Perturbations for Realistic Robustness Benchmarking of Content Moderation Models
di: Ye, Yiran, et al.
Pubblicazione: (2023)

Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction
di: Mersha, Melkamu, et al.
Pubblicazione: (2024)

ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review
di: Khowaja, Sunder Ali, et al.
Pubblicazione: (2023)

Representation Bias of Adolescents in AI: A Bilingual, Bicultural Study
di: Wolfe, Robert, et al.
Pubblicazione: (2024)

Empowering Bengali Education with AI: Solving Bengali Math Word Problems through Transformer Models
di: Era, Jalisha Jashim, et al.
Pubblicazione: (2025)

ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs
di: Heakl, Ahmed, et al.
Pubblicazione: (2024)