Imagen de Portada

Debiasing LLMs by Masking Unfairness-Driving Attention Heads

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Han, Tingxu, Song, Wei, Ding, Ziqi, Li, Ziming, Fang, Chunrong, Li, Yuekang, Liu, Dongfang, Chen, Zhenyu, Wang, Zhenting
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Token-Budget-Aware LLM Reasoning
por: Han, Tingxu, et al.
Publicado: (2024)

Mutual Information Guided Backdoor Mitigation for Pre-trained Encoders
por: Han, Tingxu, et al.
Publicado: (2024)

SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
por: Han, Tingxu, et al.
Publicado: (2026)

TombRaider: Entering the Vault of History to Jailbreak Large Language Models
por: Ding, Junchen, et al.
Publicado: (2025)

General Phrase Debiaser: Debiasing Masked Language Models at a Multi-Token Level
por: Shi, Bingkang, et al.
Publicado: (2023)

"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
por: Ding, Junchen, et al.
Publicado: (2025)

FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Models
por: Zhong, Haonan, et al.
Publicado: (2026)

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
por: Chen, Yilong, et al.
Publicado: (2024)

Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactions
por: Pan, Lei, et al.
Publicado: (2024)

Help or Hurdle? Rethinking Model Context Protocol-Augmented Large Language Models
por: Song, Wei, et al.
Publicado: (2025)

Pitfalls of Conversational LLMs on News Debiasing
por: Schlicht, Ipek Baris, et al.
Publicado: (2024)

LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding
por: Lin, Gang, et al.
Publicado: (2026)

TokenSeek: Memory Efficient Fine Tuning via Instance-Aware Token Ditching
por: Zeng, Runjia, et al.
Publicado: (2026)

Social Debiasing for Fair Multi-modal LLMs
por: Cheng, Harry, et al.
Publicado: (2024)

Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought
por: Li, Bowen, et al.
Publicado: (2026)

UGID: Unified Graph Isomorphism for Debiasing Large Language Models
por: Ding, Zikang, et al.
Publicado: (2026)

In-Context Learning State Vector with Inner and Momentum Optimization
por: Li, Dongfang, et al.
Publicado: (2024)

Position Debiasing Fine-Tuning for Causal Perception in Long-Term Dialogue
por: Fan, Shixuan, et al.
Publicado: (2024)

Causal-Guided Active Learning for Debiasing Large Language Models
por: Du, Li, et al.
Publicado: (2024)

Debiasing CLIP: Interpreting and Correcting Bias in Attention Heads
por: Yeo, Wei Jie, et al.
Publicado: (2025)

Vision Enhancing LLMs: Empowering Multimodal Knowledge Storage and Sharing in LLMs
por: Li, Yunxin, et al.
Publicado: (2023)

Intermittent Semi-Working Mask: A New Masking Paradigm for LLMs
por: Hu, HaoYuan, et al.
Publicado: (2024)

Improving Attributed Text Generation of Large Language Models via Preference Learning
por: Li, Dongfang, et al.
Publicado: (2024)

PromptBridge: Cross-Model Prompt Transfer for Large Language Models
por: Wang, Yaxuan, et al.
Publicado: (2025)

On the Role of Attention Heads in Large Language Model Safety
por: Zhou, Zhenhong, et al.
Publicado: (2024)

SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
por: Wang, Hanrui, et al.
Publicado: (2020)

Information Gain-Guided Causal Intervention for Autonomous Debiasing Large Language Models
por: Sun, Zhouhao, et al.
Publicado: (2025)

LongHeads: Multi-Head Attention is Secretly a Long Context Processor
por: Lu, Yi, et al.
Publicado: (2024)

Out-of-Distribution Detection with Attention Head Masking for Multimodal Document Classification
por: Constantinou, Christos, et al.
Publicado: (2024)

A Training-Free Length Extrapolation Approach for LLMs: Greedy Attention Logit Interpolation (GALI)
por: Li, Yan, et al.
Publicado: (2025)

Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
por: Ji, Tao, et al.
Publicado: (2025)

Debiasing Multilingual LLMs in Cross-lingual Latent Space
por: Peng, Qiwei, et al.
Publicado: (2025)

Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems
por: Wu, Xuyang, et al.
Publicado: (2024)

Fair Generation without Unfair Distortions: Debiasing Text-to-Image Generation with Entanglement-Free Attention
por: Park, Jeonghoon, et al.
Publicado: (2025)

Potential and Challenges of Model Editing for Social Debiasing
por: Yan, Jianhao, et al.
Publicado: (2024)

Semantic Refinement with LLMs for Graph Representations
por: Thapaliya, Safal, et al.
Publicado: (2025)

CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMs
por: Ranjan, Ravi, et al.
Publicado: (2026)

Continuous Concepts Removal in Text-to-image Diffusion Models
por: Han, Tingxu, et al.
Publicado: (2024)

Focusing on Language: Revealing and Exploiting Language Attention Heads in Multilingual Large Language Models
por: Liu, Xin, et al.
Publicado: (2025)

GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
por: Liao, Xutao, et al.
Publicado: (2024)