Cover Image

Bias and Uncertainty in LLM-as-a-Judge Estimation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Fiedler, James
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Methodology
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Inference for Noisy LLM-as-a-Judge Evaluation
by: Chen, Yiqun T, et al.
Published: (2026)

Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models
by: Balasubramanian, Krishnakumar, et al.
Published: (2026)

Causal Judge Evaluation: Calibrated Surrogate Metrics for LLM Systems
by: Landesberg, Eddie, et al.
Published: (2025)

Hierarchical Bias-Driven Stratification for Interpretable Causal Effect Estimation
by: Ter-Minassian, Lucile, et al.
Published: (2024)

Regression-Based Estimation of Causal Effects in the Presence of Selection Bias and Confounding
by: Hafer, Marlies, et al.
Published: (2025)

Neural Posterior Estimation on Exponential Random Graph Models: Evaluating Bias and Implementation Challenges
by: Fan, Yefeng, et al.
Published: (2025)

Fully Bayesian Spectral Clustering and Benchmarking with Uncertainty Quantification for Small Area Estimation
by: Fúquene-Patiño, Jairo
Published: (2025)

Optimal Bias-variance Tradeoff in Matrix and Tensor Estimation
by: Kumar, Shivam, et al.
Published: (2025)

Fast Uncertainty Quantification for Kernel-Based Estimators in Large-Scale Causal Inference
by: Kosko, Matthew, et al.
Published: (2026)

Direct Bias-Correction Term Estimation for Average Treatment Effect Estimation
by: Kato, Masahiro
Published: (2025)

Uncovering Bias Mechanisms in Observational Studies
by: Demirel, Ilker, et al.
Published: (2025)

Bias-Corrected Data Synthesis for Imbalanced Learning
by: Lyu, Pengfei, et al.
Published: (2025)

Uncertainty Quantification With Multiple Sources
by: Ying, Mufang, et al.
Published: (2024)

Estimating Total Effects in Bipartite Experiments with Spillovers and Partial Eligibility
by: Tan, Albert, et al.
Published: (2025)

Bias-Reduced Estimation of Finite Mixtures: An Application to Latent Group Structures in Panel Data
by: Langevin, Raphaël
Published: (2026)

Coarsening Bias from Variable Discretization in Causal Functionals
by: Ou, Xiaxian, et al.
Published: (2026)

Improving Active Learning with a Bayesian Representation of Epistemic Uncertainty
by: Thomas, Jake, et al.
Published: (2024)

Interventional Processes for Causal Uncertainty Quantification
by: Dance, Hugh, et al.
Published: (2024)

Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference
by: Arruda, Jonas, et al.
Published: (2026)

Bias-Targeted Nonparametric Balancing for Stable Causal Mediation Analysis
by: Liu, Chang, et al.
Published: (2024)

Imputation Uncertainty in Interpretable Machine Learning Methods
by: Golchian, Pegah, et al.
Published: (2025)

Integrating Uncertainty Awareness into Conformalized Quantile Regression
by: Rossellini, Raphael, et al.
Published: (2023)

Multivariate and Online Transfer Learning with Uncertainty Quantification
by: Hickey, Jimmy, et al.
Published: (2024)

Data-light Uncertainty Set Merging with Admissibility
by: Qin, Shenghao, et al.
Published: (2024)

Local Interference: Removing Interference Bias in Semi-Parametric Causal Models
by: O'Riordan, Michael, et al.
Published: (2025)

Improving Bias Correction Standards by Quantifying its Effects on Treatment Outcomes
by: Abraham, Alexandre, et al.
Published: (2024)

Estimating Interventional Distributions with Uncertain Causal Graphs through Meta-Learning
by: Dhir, Anish, et al.
Published: (2025)

On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization
by: Xiao, Jiancong, et al.
Published: (2024)

JUCAL: Jointly Calibrating Aleatoric and Epistemic Uncertainty in Classification Tasks
by: Heiss, Jakob, et al.
Published: (2026)

Wasserstein-type Gaussian Process Regressions for Input Measurement Uncertainty
by: Luo, Hengrui, et al.
Published: (2026)

Smooth Sailing: Lipschitz-Driven Uncertainty Quantification for Spatial Association
by: Burt, David R., et al.
Published: (2025)

On the Need to Align Intent and Implementation in Uncertainty Quantification for Machine Learning
by: Trivedi, Shubhendu, et al.
Published: (2025)

Knowledge Distillation of Uncertainty using Deep Latent Factor Model
by: Park, Sehyun, et al.
Published: (2025)

Contextual Online Uncertainty-Aware Preference Learning for Human Feedback
by: Lu, Nan, et al.
Published: (2025)

Wrong Model, Right Uncertainty: Spatial Associations for Discrete Data with Misspecification
by: Burt, David R., et al.
Published: (2025)

Detecting and Mitigating Group Bias in Heterogeneous Treatment Effects
by: Persson, Joel, et al.
Published: (2026)

Score Matching for Truncated Density Estimation on a Manifold
by: Williams, Daniel J., et al.
Published: (2022)

Confidence Diagram of Nonparametric Ranking for Uncertainty Assessment in Large Language Models Evaluation
by: Wang, Zebin, et al.
Published: (2024)

Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models
by: Scheurer, Stefania, et al.
Published: (2025)

Robust Variable Selection and Estimation Via Adaptive Elastic Net S-Estimators for Linear Regression
by: Kepplinger, David
Published: (2021)