Cover Image

Causal Judge Evaluation: Calibrated Surrogate Metrics for LLM Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Landesberg, Eddie, Narayan, Manjari
Format:	Preprint
Published:	2025
Subjects:	Methodology Applications Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Inference for Noisy LLM-as-a-Judge Evaluation
by: Chen, Yiqun T, et al.
Published: (2026)

On the Role of Surrogates in Conformal Inference of Individual Causal Effects
by: Gao, Chenyin, et al.
Published: (2024)

Dynamic Classification of Latent Disease Progression with Auxiliary Surrogate Labels
by: Cai, Zexi, et al.
Published: (2024)

Causal Responder Detection
by: Frostig, Tzviel, et al.
Published: (2024)

A Transfer Learning Causal Approach to Evaluate Racial/Ethnic and Geographic Variation in Outcomes Following Congenital Heart Surgery
by: Han, Larry, et al.
Published: (2024)

Salvaging Forbidden Treasure in Medical Data: Utilizing Surrogate Outcomes and Single Records for Rare Event Modeling
by: Yin, Xiaohui, et al.
Published: (2025)

When LLM Judge Scores Look Good but Best-of-N Decisions Fail
by: Landesberg, Eddie
Published: (2026)

Testing Generalizability in Causal Inference
by: Manela, Daniel de Vassimon, et al.
Published: (2024)

Causal Feature Learning in the Social Sciences
by: Huang, Jingzhou, et al.
Published: (2025)

Assumption-Lean Post-Integrated Inference with Surrogate Control Outcomes
by: Du, Jin-Hong, et al.
Published: (2024)

Generative Bayesian Computation as a Scalable Alternative to Gaussian Process Surrogates
by: Polson, Nick, et al.
Published: (2026)

Causal Inference for Genomic Data with Multiple Heterogeneous Outcomes
by: Du, Jin-Hong, et al.
Published: (2024)

Optimal Sampling for Generalized Linear Model under Measurement Constraint with Surrogate Variables
by: Shen, Yixin, et al.
Published: (2025)

Sample Efficient Bayesian Learning of Causal Graphs from Interventions
by: Zhou, Zihan, et al.
Published: (2024)

Sparsity, Regularization and Causality in Agricultural Yield: The Case of Paddy Rice in Peru
by: Guzman-Lopez, Rita Rocio, et al.
Published: (2024)

A Bayesian Framework for Causal Analysis of Recurrent Events with Timing Misalignment
by: Oganisian, Arman, et al.
Published: (2023)

Hybrid$^2$ Neural ODE Causal Modeling and an Application to Glycemic Response
by: Zou, Bob Junyi, et al.
Published: (2024)

A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillation
by: Song, Xinran, et al.
Published: (2025)

Fast Uncertainty Quantification for Kernel-Based Estimators in Large-Scale Causal Inference
by: Kosko, Matthew, et al.
Published: (2026)

A Causal Machine Learning Framework for Treatment Personalization in Clinical Trials: Application to Ulcerative Colitis
by: Minoccheri, Cristian, et al.
Published: (2026)

Mining Causality: AI-Assisted Search for Instrumental Variables
by: Han, Sukjin
Published: (2024)

Causal Mediation Analysis with Multiple Mediators: A Simulation Approach
by: Zhou, Jesse, et al.
Published: (2025)

Summarizing Bayesian Nonparametric Mixture Posterior -- Sliced Optimal Transport Metrics for Gaussian Mixtures
by: Nguyen, Khai, et al.
Published: (2024)

Double Machine Learning at Scale to Predict Causal Impact of Customer Actions
by: More, Sushant, et al.
Published: (2024)

Post Launch Evaluation of Policies in a High-Dimensional Setting
by: Nassiri, Shima, et al.
Published: (2024)

Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework
by: Binette, Olivier, et al.
Published: (2024)

Distributed Causality in the SDG Network: Evidence from Panel VAR and Conditional Independence Analysis
by: Fahim, Md Muhtasim Munif, et al.
Published: (2026)

Evaluation of Missing Data Analytical Techniques in Longitudinal Research: Traditional and Machine Learning Approaches
by: Tang, Dandan, et al.
Published: (2024)

ROC Analysis with Covariate Adjustment Using Neural Network Models: Evaluating the Role of Age in the Physical Activity-Mortality Association
by: Hammouri, Ziad Akram Ali, et al.
Published: (2025)

Causal Machine Learning for Surgical Interventions
by: Tamo, J. Ben, et al.
Published: (2025)

MCMC with Adaptive Principal-Component Transformation: Rotation-Invariant Universal Samplers for Bayesian Structural System Identification
by: Meng, Xianghao, et al.
Published: (2026)

Extracting the Multiscale Causal Backbone of Brain Dynamics
by: D'Acunto, Gabriele, et al.
Published: (2023)

Causal Graph Recovery in Neuroimaging through Answer Set Programming
by: Abavisani, Mohammadsajad, et al.
Published: (2025)

Identifying and Estimating Causal Direct Effects Under Unmeasured Confounding
by: Boileau, Philippe, et al.
Published: (2026)

LLM-based Agents for Automated Confounder Discovery and Subgroup Analysis in Causal Inference
by: Lee, Po-Han, et al.
Published: (2025)

Evaluation of Surrogate Endpoints Based on Meta-Analysis with Surrogate Indices
by: Stijven, Florian, et al.
Published: (2025)

iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models
by: Chen, Tianyu, et al.
Published: (2023)

A Design-based Solution for Causal Inference with Text: Can a Language Model Be Too Large?
by: Tierney, Graham, et al.
Published: (2025)

An Algorithmic Approach for Causal Health Equity: A Look at Race Differentials in Intensive Care Unit (ICU) Outcomes
by: Plecko, Drago, et al.
Published: (2025)

Modelling non-stationary extremal dependence through a geometric approach
by: Murphy-Barltrop, C. J. R., et al.
Published: (2025)