Imagen de Portada

Likelihood-based Mitigation of Evaluation Bias in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Oi, Masanari, Kaneko, Masahiro, Koike, Ryuto, Loem, Mengsay, Okazaki, Naoaki
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks
por: Loem, Mengsay, et al.
Publicado: (2023)

Intent-Aware Self-Correction for Mitigating Social Biases in Large Language Models
por: Anantaprayoon, Panatchakorn, et al.
Publicado: (2025)

Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language Models
por: Ohi, Masanari, et al.
Publicado: (2024)

Building a Large Japanese Web Corpus for Large Language Models
por: Okazaki, Naoaki, et al.
Publicado: (2024)

OUTFOX: LLM-Generated Essay Detection Through In-Context Learning with Adversarially Generated Examples
por: Koike, Ryuto, et al.
Publicado: (2023)

How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection
por: Koike, Ryuto, et al.
Publicado: (2023)

Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities
por: Fujii, Kazuki, et al.
Publicado: (2024)

Synthesizing Instruction-Tuning Datasets with Contrastive Decoding
por: Ichinose, Tatsuya, et al.
Publicado: (2026)

LLM Output Detectability and Task Performance Can be Jointly Optimized
por: Saito, Koshiro, et al.
Publicado: (2026)

Social Bias Evaluation for Large Language Models Requires Prompt Variations
por: Hida, Rem, et al.
Publicado: (2024)

Autoregressive Direct Preference Optimization
por: Oi, Masanari, et al.
Publicado: (2026)

ExaGPT: Example-Based Machine-Generated Text Detection for Human Interpretability
por: Koike, Ryuto, et al.
Publicado: (2025)

Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All Labels
por: Anantaprayoon, Panatchakorn, et al.
Publicado: (2023)

Evaluating Gender Bias in Large Language Models via Chain-of-Thought Prompting
por: Kaneko, Masahiro, et al.
Publicado: (2024)

Machine Text Detectors are Membership Inference Attacks
por: Koike, Ryuto, et al.
Publicado: (2025)

From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
por: Oi, Masanari, et al.
Publicado: (2026)

A Japanese Benchmark for Evaluating Social Bias in Reasoning Based on Attribution Theory
por: Shiotani, Taihei, et al.
Publicado: (2026)

Sampling-based Pseudo-Likelihood for Membership Inference Attacks
por: Kaneko, Masahiro, et al.
Publicado: (2024)

Joint Extraction Matters: Prompt-Based Visual Question Answering for Multi-Field Document Information Extraction
por: Loem, Mengsay, et al.
Publicado: (2025)

Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach
por: Kaneko, Masahiro, et al.
Publicado: (2023)

Contrasting Cognitive Styles in Vision-Language Models: Holistic Attention in Japanese Versus Analytical Focus in English
por: Sabir, Ahmed, et al.
Publicado: (2025)

Locating and Mitigating Gender Bias in Large Language Models
por: Cai, Yuchen, et al.
Publicado: (2024)

Multi-Persona Thinking for Bias Mitigation in Large Language Models
por: Chen, Yuxing, et al.
Publicado: (2026)

Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs
por: Miyamoto, Sora, et al.
Publicado: (2026)

Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory
por: Deng, Yongxin, et al.
Publicado: (2024)

Large Language Model Bias Mitigation from the Perspective of Knowledge Editing
por: Chen, Ruizhe, et al.
Publicado: (2024)

Paraphrasing Adversarial Attack on LLM-as-a-Reviewer
por: Kaneko, Masahiro
Publicado: (2026)

GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Models
por: Zhang, Tao, et al.
Publicado: (2024)

JUBAKU: An Adversarial Benchmark for Exposing Culturally Grounded Stereotypes in Japanese LLMs
por: Shiotani, Taihei, et al.
Publicado: (2026)

Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models
por: Lu, Zhenyi, et al.
Publicado: (2024)

LFTF: Locating First and Then Fine-Tuning for Mitigating Gender Bias in Large Language Models
por: Qin, Zhanyue, et al.
Publicado: (2025)

Auto-Search and Refinement: An Automated Framework for Gender Bias Mitigation in Large Language Models
por: Xu, Yue, et al.
Publicado: (2025)

Simulating a Bias Mitigation Scenario in Large Language Models
por: Kiashemshaki, Kiana, et al.
Publicado: (2025)

Identifying and Mitigating Social Bias Knowledge in Language Models
por: Chen, Ruizhe, et al.
Publicado: (2024)

No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models
por: Kumar, Charaka Vinayak, et al.
Publicado: (2025)

BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responses
por: Xu, Xin, et al.
Publicado: (2025)

JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understanding
por: Maeda, Koki, et al.
Publicado: (2026)

Vision Language Model-based Caption Evaluation Method Leveraging Visual Context Extraction
por: Maeda, Koki, et al.
Publicado: (2024)

AdEval: Alignment-based Dynamic Evaluation to Mitigate Data Contamination in Large Language Models
por: Fan, Yang
Publicado: (2025)

Self-Preference Bias in Rubric-Based Evaluation of Large Language Models
por: Pombal, José, et al.
Publicado: (2026)