Copertina

Probability of Differentiation Reveals Brittleness of Homogeneity Bias in GPT-4

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lee, Messi H. J., Lai, Calvin K.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Examining the Robustness of Homogeneity Bias to Hyperparameter Adjustments in GPT-4
di: Lee, Messi H. J.
Pubblicazione: (2025)

Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humans
di: Lee, Messi H. J., et al.
Pubblicazione: (2024)

Implicit Bias-Like Patterns in Reasoning Models
di: Lee, Messi H. J., et al.
Pubblicazione: (2025)

Token-Level Entropy Reveals Demographic Disparities in Language Models
di: Lee, Messi H. J.
Pubblicazione: (2025)

More Distinctively Black and Feminine Faces Lead to Increased Stereotyping in Vision-Language Models
di: Lee, Messi H. J., et al.
Pubblicazione: (2024)

Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individuals
di: Lee, Messi H. J., et al.
Pubblicazione: (2024)

Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases
di: Gao, Bufan, et al.
Pubblicazione: (2025)

Bias Attribution in Filipino Language Models: Extending a Bias Interpretability Metric for Application on Agglutinative Languages
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2025)

Robust Bias Evaluation with FilBBQ: A Filipino Bias Benchmark for Question-Answering Language Models
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2026)

Filipino Benchmarks for Measuring Sexist and Homophobic Bias in Multilingual Language Models from Southeast Asia
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2024)

Social Bias in Multilingual Language Models: A Survey
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2025)

Visual Cues of Gender and Race are Associated with Stereotyping in Vision-Language Models
di: Lee, Messi H. J., et al.
Pubblicazione: (2025)

A Novel Interpretability Metric for Explaining Bias in Language Models: Applications on Multilingual Models from Southeast Asia
di: Gamboa, Lance Calvin Lim, et al.
Pubblicazione: (2024)

Weird Generalization is Weirdly Brittle
di: Wanner, Miriam, et al.
Pubblicazione: (2026)

Are Humans as Brittle as Large Language Models?
di: Li, Jiahui, et al.
Pubblicazione: (2025)

Systematic Diagnosis of Brittle Reasoning in Large Language Models
di: Parupudi, V. S. Raghu
Pubblicazione: (2025)

On the Brittleness of LLMs: A Journey around Set Membership
di: Hergert, Lea, et al.
Pubblicazione: (2025)

Token Homogenization under Positional Bias
di: Yusupov, Viacheslav, et al.
Pubblicazione: (2025)

Certain but not Probable? Differentiating Certainty from Probability in LLM Token Outputs for Probabilistic Scenarios
di: Toney-Wails, Autumn, et al.
Pubblicazione: (2025)

LLM Knowledge is Brittle: Truthfulness Representations Rely on Superficial Resemblance
di: Haller, Patrick, et al.
Pubblicazione: (2025)

Detecting Bias in Large Language Models: Fine-tuned KcBERT
di: Lee, J. K., et al.
Pubblicazione: (2024)

LLMs Show Surface-Form Brittleness Under Paraphrase Stress Tests
di: Carranza, Juan Miguel Navarro
Pubblicazione: (2025)

Examining Multimodal Gender and Content Bias in ChatGPT-4o
di: Balestri, Roberto
Pubblicazione: (2024)

Textual Entailment is not a Better Bias Metric than Token Probability
di: Felkner, Virginia K., et al.
Pubblicazione: (2025)

An Evaluation of GPT-4V for Transcribing the Urban Renewal Hand-Written Collection
di: Lee, Myeong, et al.
Pubblicazione: (2024)

Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination
di: Fleisig, Eve, et al.
Pubblicazione: (2024)

Generalization or Memorization? Brittleness Testing for Chess-Trained Language Models
di: Tang, Ethan
Pubblicazione: (2026)

On the Brittle Foundations of ReAct Prompting for Agentic Large Language Models
di: Verma, Mudit, et al.
Pubblicazione: (2024)

Brittle Minds, Fixable Activations: Understanding Belief Representations in Language Models
di: Bortoletto, Matteo, et al.
Pubblicazione: (2024)

Brittleness and Promise: Knowledge Graph Based Reward Modeling for Diagnostic Reasoning
di: Khatwani, Saksham, et al.
Pubblicazione: (2025)

Benchmarking Llama2, Mistral, Gemma and GPT for Factuality, Toxicity, Bias and Propensity for Hallucinations
di: Nadeau, David, et al.
Pubblicazione: (2024)

Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
di: Bao, Guangsheng, et al.
Pubblicazione: (2023)

How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses
di: Urchs, Stefanie, et al.
Pubblicazione: (2023)

Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation
di: Kim, Takyoung, et al.
Pubblicazione: (2023)

Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors
di: Ali, Adnan Al, et al.
Pubblicazione: (2026)

Your Agent is More Brittle Than You Think: Uncovering Indirect Injection Vulnerabilities in Agentic LLMs
di: Zhu, Wenhui, et al.
Pubblicazione: (2026)

Does GPT-4 pass the Turing test?
di: Jones, Cameron R., et al.
Pubblicazione: (2023)

ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models
di: Wen, Zehao, et al.
Pubblicazione: (2024)

Using GPT-4 to Augment Unbalanced Data for Automatic Scoring
di: Fang, Luyang, et al.
Pubblicazione: (2023)

100% Elimination of Hallucinations on RAGTruth for GPT-4 and GPT-3.5 Turbo
di: Wood, Michael C., et al.
Pubblicazione: (2024)