Image de couverture de livre

Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Heads

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yang, Yi, Duan, Hanyu, Abbasi, Ahmed, Lalor, John P., Tam, Kar Yan
Format:	Preprint
Publié:	2023
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States
par: Duan, Hanyu, et autres
Publié: (2024)

LLM-Measure: Generating Valid, Consistent, and Reproducible Text-Based Measures for Social Science Research
par: Yang, Yi, et autres
Publié: (2024)

PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins
par: Chen, Sihan, et autres
Publié: (2025)

Bridging the LLM Accessibility Divide? Performance, Fairness, and Cost of Closed versus Open LLMs for Automated Essay Scoring
par: Oketch, Kezia, et autres
Publié: (2025)

Benchmarking Sociolinguistic Diversity in Swahili NLP: A Taxonomy-Guided Approach
par: Oketch, Kezia, et autres
Publié: (2025)

Robust Predictive Modeling Under Unseen Data Distribution Shifts: A Methodological Commentary
par: Duan, Hanyu, et autres
Publié: (2025)

Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness
par: Duan, Hanyu, et autres
Publié: (2025)

BiasDPO: Mitigating Bias in Language Models through Direct Preference Optimization
par: Allam, Ahmed
Publié: (2024)

Debiasing CLIP: Interpreting and Correcting Bias in Attention Heads
par: Yeo, Wei Jie, et autres
Publié: (2025)

Layer-wise Representation Dynamics: An Empirical Investigation Across Embedders and Base LLMs
par: Jiang, Jingzhou, et autres
Publié: (2026)

Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives
par: Liu, Jiaxin, et autres
Publié: (2024)

Bias in, Bias out: Annotation Bias in Multilingual Large Language Models
par: Cui, Xia, et autres
Publié: (2025)

Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models
par: Sorokovikova, Aleksandra, et autres
Publié: (2025)

JBBQ: Japanese Bias Benchmark for Analyzing Social Biases in Large Language Models
par: Yanaka, Hitomi, et autres
Publié: (2024)

Investigating Spatial Attention Bias in Vision-Language Models
par: Chaudhary, Aryan, et autres
Publié: (2025)

Modality Bias in LVLMs: Analyzing and Mitigating Object Hallucination via Attention Lens
par: Zheng, Haohan, et autres
Publié: (2025)

Analyzing Language Bias Between French and English in Conventional Multilingual Sentiment Analysis Models
par: Wong, Ethan Parker, et autres
Publié: (2024)

Analyzing Bias in False Refusal Behavior of Large Language Models for Hate Speech Detoxification
par: Im, Kyuri, et autres
Publié: (2026)

Measuring Spiritual Values and Bias of Large Language Models
par: Liu, Songyuan, et autres
Publié: (2024)

Analyzing Bias in Swiss Federal Supreme Court Judgments Using Facebook's Holistic Bias Dataset: Implications for Language Model Training
par: Wehnert, Sabine, et autres
Publié: (2025)

Unlocking Bias Detection: Leveraging Transformer-Based Models for Content Analysis
par: Raza, Shaina, et autres
Publié: (2023)

Mitigating Biases in Language Models via Bias Unlearning
par: Liu, Dianqing, et autres
Publié: (2025)

KLAAD: Refining Attention Mechanisms to Reduce Societal Bias in Generative Language Models
par: Kim, Seorin, et autres
Publié: (2025)

Regional Bias in Large Language Models
par: Gopinadh, M P V S, et autres
Publié: (2026)

Analyzing Multi-Head Attention on Trojan BERT Models
par: Wang, Jingwei
Publié: (2024)

BiasGuard: A Reasoning-enhanced Bias Detection Tool For Large Language Models
par: Fan, Zhiting, et autres
Publié: (2025)

RuBia: A Russian Language Bias Detection Dataset
par: Grigoreva, Veronika, et autres
Publié: (2024)

Open-DeBias: Toward Mitigating Open-Set Bias in Language Models
par: Rani, Arti, et autres
Publié: (2025)

Energy-Gated Attention: Spectral Salience as an Inductive Bias for Transformer Attention
par: Zeris, Athanasios
Publié: (2026)

Mitigating the Bias of Large Language Model Evaluation
par: Zhou, Hongli, et autres
Publié: (2024)

BiasJailbreak:Analyzing Ethical Biases and Jailbreak Vulnerabilities in Large Language Models
par: Lee, Isack, et autres
Publié: (2024)

Attention Speaks Volumes: Localizing and Mitigating Bias in Language Models
par: Adiga, Rishabh, et autres
Publié: (2024)

Interpreting Bias in Large Language Models: A Feature-Based Approach
par: Prakash, Nirmalendu, et autres
Publié: (2024)

AesBiasBench: Evaluating Bias and Alignment in Multimodal Language Models for Personalized Image Aesthetic Assessment
par: Li, Kun, et autres
Publié: (2025)

Problematic Tokens: Tokenizer Bias in Large Language Models
par: Yang, Jin, et autres
Publié: (2024)

Acquiescence Bias in Large Language Models
par: Braun, Daniel
Publié: (2025)

ParlAI Vote: A Web Platform for Analyzing Gender and Political Bias in Large Language Models
par: Lin, Wenjie, et autres
Publié: (2025)

The Media Bias Detector: A Framework for Annotating and Analyzing the News at Scale
par: Haider, Samar, et autres
Publié: (2025)

To Bias or Not to Bias: Detecting bias in News with bias-detector
par: Ghosh, Himel, et autres
Publié: (2025)

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias
par: Sadhu, Jayanta, et autres
Publié: (2024)