Social Bias Evaluation for Large Language Models Requires Prompt Variations

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hida, Rem, Kaneko, Masahiro, Okazaki, Naoaki
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Evaluating Gender Bias in Large Language Models via Chain-of-Thought Prompting
di: Kaneko, Masahiro, et al.
Pubblicazione: (2024)

Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All Labels
di: Anantaprayoon, Panatchakorn, et al.
Pubblicazione: (2023)

A Japanese Benchmark for Evaluating Social Bias in Reasoning Based on Attribution Theory
di: Shiotani, Taihei, et al.
Pubblicazione: (2026)

Intent-Aware Self-Correction for Mitigating Social Biases in Large Language Models
di: Anantaprayoon, Panatchakorn, et al.
Pubblicazione: (2025)

Likelihood-based Mitigation of Evaluation Bias in Large Language Models
di: Oi, Masanari, et al.
Pubblicazione: (2024)

How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection
di: Koike, Ryuto, et al.
Pubblicazione: (2023)

Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation
di: Hida, Rem, et al.
Pubblicazione: (2024)

Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language Models
di: Ohi, Masanari, et al.
Pubblicazione: (2024)

OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examples
di: Koike, Ryuto, et al.
Pubblicazione: (2023)

Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach
di: Kaneko, Masahiro, et al.
Pubblicazione: (2023)

SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks
di: Loem, Mengsay, et al.
Pubblicazione: (2023)

Sampling-based Pseudo-Likelihood for Membership Inference Attacks
di: Kaneko, Masahiro, et al.
Pubblicazione: (2024)

LLM Output Detectability and Task Performance Can be Jointly Optimized
di: Saito, Koshiro, et al.
Pubblicazione: (2026)

Stopping Computation for Converged Tokens in Masked Diffusion-LM Decoding
di: Oba, Daisuke, et al.
Pubblicazione: (2026)

In-Contextual Gender Bias Suppression for Large Language Models
di: Oba, Daisuke, et al.
Pubblicazione: (2023)

ExaGPT: Example-Based Machine-Generated Text Detection for Human Interpretability
di: Koike, Ryuto, et al.
Pubblicazione: (2025)

Knowledge of Pretrained Language Models on Surface Information of Tokens
di: Hiraoka, Tatsuya, et al.
Pubblicazione: (2024)

From Interpretability to Performance: Optimizing Retrieval Heads for Long-Context Language Models
di: Ma, Youmi, et al.
Pubblicazione: (2026)

Machine Text Detectors are Membership Inference Attacks
di: Koike, Ryuto, et al.
Pubblicazione: (2025)

Drifting Objectives for Refining Discrete Diffusion Language Models
di: Oba, Daisuke, et al.
Pubblicazione: (2026)

JUBAKU: An Adversarial Benchmark for Exposing Culturally Grounded Stereotypes in Japanese LLMs
di: Shiotani, Taihei, et al.
Pubblicazione: (2026)

Diffusion-State Policy Optimization for Masked Diffusion Language Models
di: Oba, Daisuke, et al.
Pubblicazione: (2026)

Tokenization as Finite-State Transduction
di: Cognetta, Marco, et al.
Pubblicazione: (2024)

The Gaps between Pre-train and Downstream Settings in Bias Evaluation and Debiasing
di: Kaneko, Masahiro, et al.
Pubblicazione: (2024)

A Little Leak Will Sink a Great Ship: Survey of Transparency for Large Language Models from Start to Finish
di: Kaneko, Masahiro, et al.
Pubblicazione: (2024)

On the Alignment of Large Language Models with Global Human Opinion
di: Liu, Yang, et al.
Pubblicazione: (2025)

Building a Japanese Document-Level Relation Extraction Dataset Assisted by Cross-Lingual Transfer
di: Ma, Youmi, et al.
Pubblicazione: (2024)

Evaluating the Generalization Capabilities of Large Language Models on Code Reasoning
di: Yang, Rem, et al.
Pubblicazione: (2025)

Balanced Multi-Factor In-Context Learning for Multilingual Large Language Models
di: Kaneko, Masahiro, et al.
Pubblicazione: (2025)

Distributional Properties of Subword Regularization
di: Cognetta, Marco, et al.
Pubblicazione: (2024)

Bit-level BPE: Below the byte boundary
di: Moon, Sangwhan, et al.
Pubblicazione: (2025)

WAON: A Large-Scale Japanese Image-Text Dataset for Cultural Adaptation in Contrastive Vision-Language Models
di: Sugiura, Issa, et al.
Pubblicazione: (2025)

Online Learning Defense against Iterative Jailbreak Attacks via Prompt Optimization
di: Kaneko, Masahiro, et al.
Pubblicazione: (2025)

Constructing Multimodal Datasets from Scratch for Rapid Development of a Japanese Visual Language Model
di: Sasagawa, Keito, et al.
Pubblicazione: (2024)

Two Counterexamples to Tokenization and the Noiseless Channel
di: Cognetta, Marco, et al.
Pubblicazione: (2024)

Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs
di: Miyamoto, Sora, et al.
Pubblicazione: (2026)

Evaluating and Mitigating Social Bias for Large Language Models in Open-ended Settings
di: Liu, Zhao, et al.
Pubblicazione: (2024)

BiasCause: Evaluate Socially Biased Causal Reasoning of Large Language Models
di: Xie, Tian, et al.
Pubblicazione: (2025)

Building a Large Japanese Web Corpus for Large Language Models
di: Okazaki, Naoaki, et al.
Pubblicazione: (2024)

Evaluating Gender Bias in Large Language Models
di: Döll, Michael, et al.
Pubblicazione: (2024)