Copertina

Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ye, Jiayi, Wang, Yanbo, Huang, Yue, Chen, Dongping, Zhang, Qihui, Moniz, Nuno, Gao, Tian, Geyer, Werner, Huang, Chao, Chen, Pin-Yu, Chawla, Nitesh V, Zhang, Xiangliang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Capability-Oriented Training Induced Alignment Risk
di: Zhou, Yujun, et al.
Pubblicazione: (2026)

Fast Explanations via Policy Gradient-Optimized Explainer
di: Pan, Deng, et al.
Pubblicazione: (2024)

Conformalized Selective Regression
di: Sokol, Anna, et al.
Pubblicazione: (2024)

Are we making much progress? Revisiting chemical reaction yield prediction from an imbalanced regression perspective
di: Ma, Yihong, et al.
Pubblicazione: (2024)

AnyLoss: Transforming Classification Metrics into Loss Functions
di: Han, Doheon, et al.
Pubblicazione: (2024)

Intersectional Divergence: Measuring Fairness in Regression
di: Germino, Joe, et al.
Pubblicazione: (2025)

From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews
di: Nogueira, Brenda, et al.
Pubblicazione: (2025)

BenchmarkCards: Standardized Documentation for Large Language Model Benchmarks
di: Sokol, Anna, et al.
Pubblicazione: (2024)

LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labs
di: Zhou, Yujun, et al.
Pubblicazione: (2024)

Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
di: Wang, Yanbo, et al.
Pubblicazione: (2025)

Differentially-Private Data Synthetisation for Efficient Re-Identification Risk Control
di: Carvalho, Tânia, et al.
Pubblicazione: (2022)

Class-Aware Contrastive Optimization for Imbalanced Text Classification
di: Khvatskii, Grigorii, et al.
Pubblicazione: (2024)

HonestLLM: Toward an Honest and Helpful Large Language Model
di: Gao, Chujie, et al.
Pubblicazione: (2024)

AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive
di: Guo, Taicheng, et al.
Pubblicazione: (2026)

Context Attribution with Multi-Armed Bandit Optimization
di: Pan, Deng, et al.
Pubblicazione: (2025)

MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
di: Chen, Dongping, et al.
Pubblicazione: (2024)

Guardian-as-an-Advisor: Advancing Next-Generation Guardian Models for Trustworthy LLMs
di: Huang, Yue, et al.
Pubblicazione: (2026)

Spectral Manifold Harmonization for Graph Imbalanced Regression
di: Nogueira, Brenda, et al.
Pubblicazione: (2025)

Genotype-Conditioned Molecular Generation via Evidence-Grounded Multi-Objective Latent Perturbation in Diffusion Models
di: Nogueira, Brenda, et al.
Pubblicazione: (2026)

Emergent Social Intelligence Risks in Generative Multi-Agent Systems
di: Huang, Yue, et al.
Pubblicazione: (2026)

My Favorite Streamer is an LLM: Discovering, Bonding, and Co-Creating in AI VTuber Fandom
di: Ye, Jiayi, et al.
Pubblicazione: (2025)

NGQA: A Nutritional Graph Question Answering Benchmark for Personalized Health-aware Nutritional Reasoning
di: Zhang, Zheyuan, et al.
Pubblicazione: (2024)

UGMAE: A Unified Framework for Graph Masked Autoencoders
di: Tian, Yijun, et al.
Pubblicazione: (2024)

SPECTRA: Spectral Domain-Aware Graph Generation for Imbalanced Molecular Property Regression
di: Nogueira, Brenda, et al.
Pubblicazione: (2025)

SPA: Achieving Consensus in LLM Alignment via Self-Priority Optimization
di: Huang, Yue, et al.
Pubblicazione: (2025)

PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models
di: Bao, Han, et al.
Pubblicazione: (2026)

AutoBench-V: Can Large Vision-Language Models Benchmark Themselves?
di: Bao, Han, et al.
Pubblicazione: (2024)

DataGen: Unified Synthetic Dataset Generation via Large Language Models
di: Huang, Yue, et al.
Pubblicazione: (2024)

RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty
di: Zhang, Ziqian, et al.
Pubblicazione: (2026)

Quantifying LLM Biases Across Instruction Boundary in Mixed Question Forms
di: Ling, Zipeng, et al.
Pubblicazione: (2025)

LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected?
di: Zhang, Qihui, et al.
Pubblicazione: (2024)

UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation
di: Zhang, Qihui, et al.
Pubblicazione: (2025)

Cross-Lingual Pitfalls: Automatic Probing Cross-Lingual Weakness of Multilingual Large Language Models
di: Xu, Zixiang, et al.
Pubblicazione: (2025)

Are We on the Right Way to Assessing LLM-as-a-Judge?
di: Feng, Yuanning, et al.
Pubblicazione: (2025)

ChefFusion: Multimodal Foundation Model Integrating Recipe and Food Image Generation
di: Li, Peiyu, et al.
Pubblicazione: (2024)

Jailbreaking Large Language Models Through Alignment Vulnerabilities in Out-of-Distribution Settings
di: Huang, Yue, et al.
Pubblicazione: (2024)

Reasoning Model Is Superior LLM-Judge, Yet Suffers from Biases
di: Huang, Hui, et al.
Pubblicazione: (2026)

A Survey of Large Language Models for Graphs
di: Ren, Xubin, et al.
Pubblicazione: (2024)

Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplifications and Resistance in Multi-Agent Based LLM-as-Judge
di: Ma, Chiyu, et al.
Pubblicazione: (2025)

Large Language Model based Multi-Agents: A Survey of Progress and Challenges
di: Guo, Taicheng, et al.
Pubblicazione: (2024)