Cover Image

Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Binette, Olivier, Reiter, Jerome P.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Applications Methodology
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Gaussian Copula Models for Nonignorable Missing Data Using Auxiliary Marginal Quantiles
by: Feldman, Joseph, et al.
Published: (2024)

Evaluating Binary Outcome Classifiers Estimated from Survey Data
by: Wadekar, Adway S., et al.
Published: (2023)

A Sensitivity Analysis Framework for Quantifying Confidence in Decisions in the Presence of Data Uncertainty
by: Wadekar, Adway S., et al.
Published: (2025)

Imputation of Nonignorable Missing Data in Surveys Using Auxiliary Margins Via Hot Deck and Sequential Imputation
by: Yang, Yanjiao, et al.
Published: (2024)

How to Evaluate Entity Resolution Systems: An Entity-Centric Framework with Application to Inventor Name Disambiguation
by: Binette, Olivier, et al.
Published: (2024)

The Estimand Framework and Causal Inference: Complementary not Competing Paradigms
by: Drury, Thomas, et al.
Published: (2024)

Neural Networks for Extreme Quantile Regression with an Application to Forecasting of Flood Risk
by: Pasche, Olivier C., et al.
Published: (2022)

Performance of Cross-Validated Targeted Maximum Likelihood Estimation
by: Smith, Matthew J., et al.
Published: (2024)

A Honest Cross-Validation Estimator for Prediction Performance
by: Pan, Tianyu, et al.
Published: (2025)

Toward Valid Generative Clinical Trial Data with Survival Endpoints
by: Chassat, Perrine, et al.
Published: (2025)

Extreme Conformal Prediction: Reliable Intervals for High-Impact Events
by: Pasche, Olivier C., et al.
Published: (2025)

ROC Analysis with Covariate Adjustment Using Neural Network Models: Evaluating the Role of Age in the Physical Activity-Mortality Association
by: Hammouri, Ziad Akram Ali, et al.
Published: (2025)

Outcome-Assisted Multiple Imputation of Missing Treatments
by: Feldman, Joseph, et al.
Published: (2025)

Testing and Improving the Robustness of Amortized Bayesian Inference for Cognitive Models
by: Wu, Yufei, et al.
Published: (2024)

Practical considerations when designing an online learning algorithm for an app-based mHealth intervention
by: Gonzalez, Rachel T, et al.
Published: (2025)

Improved prediction of future user activity in online A/B testing
by: Masoero, Lorenzo, et al.
Published: (2024)

Adaptive Selection of the Optimal Strategy to Improve Precision and Power in Randomized Trials
by: Balzer, Laura B., et al.
Published: (2022)

Changepoint Detection As Model Selection: A General Framework
by: Grantham, Michael, et al.
Published: (2026)

Adversarial Drift-Aware Predictive Transfer: Toward Durable Clinical AI
by: Xiong, Xin, et al.
Published: (2026)

Efficient Inference for Noisy LLM-as-a-Judge Evaluation
by: Chen, Yiqun T, et al.
Published: (2026)

Data reuse enables cost-efficient randomized trials of medical AI models
by: Nercessian, Michael, et al.
Published: (2025)

Variable Selection Methods for Multivariate, Functional, and Complex Biomedical Data in the AI Age
by: Matabuena, Marcos
Published: (2025)

Post Launch Evaluation of Policies in a High-Dimensional Setting
by: Nassiri, Shima, et al.
Published: (2024)

Causal Judge Evaluation: Calibrated Surrogate Metrics for LLM Systems
by: Landesberg, Eddie, et al.
Published: (2025)

Fusing Individualized Treatment Rules Using Secondary Outcomes
by: Gao, Daiqi, et al.
Published: (2024)

A Bayesian Framework for Causal Analysis of Recurrent Events with Timing Misalignment
by: Oganisian, Arman, et al.
Published: (2023)

A Unified Combination Framework for Dependent Tests with Applications to Microbiome Association Studies
by: Yu, Xiufan, et al.
Published: (2024)

A Bayesian Framework for Post-disruption Travel Time Prediction in Metro Networks
by: Nazemi, Shayan, et al.
Published: (2026)

A Generative Framework for Causal Estimation via Importance-Weighted Diffusion Distillation
by: Song, Xinran, et al.
Published: (2025)

Depth-Based Local Center Clustering: A Framework for Handling Different Clustering Scenarios
by: Wang, Siyi, et al.
Published: (2025)

An Agglomerative Clustering of Simulation Output Distributions Using Regularized Wasserstein Distance
by: Ghasemloo, Mohammadmahdi, et al.
Published: (2024)

HMM for Discovering Decision-Making Dynamics Using Reinforcement Learning Experiments
by: Guo, Xingche, et al.
Published: (2024)

Evaluation of Missing Data Analytical Techniques in Longitudinal Research: Traditional and Machine Learning Approaches
by: Tang, Dandan, et al.
Published: (2024)

A Causal Machine Learning Framework for Treatment Personalization in Clinical Trials: Application to Ulcerative Colitis
by: Minoccheri, Cristian, et al.
Published: (2026)

A Large Scale Heterogeneous Treatment Effect Estimation Framework and Its Applications of Users' Journey at Snap
by: Pan, Jing, et al.
Published: (2025)

Prediction of Respiratory Syncytial Virus-Associated Hospitalizations Using Machine Learning Models Based on Environmental Data
by: Guo, Eric
Published: (2025)

A Transfer Learning Causal Approach to Evaluate Racial/Ethnic and Geographic Variation in Outcomes Following Congenital Heart Surgery
by: Han, Larry, et al.
Published: (2024)

Nonparametric estimation of the Patient Weighted While-Alive Estimand
by: Ragni, Alessandra, et al.
Published: (2024)

On Using Large Language Models to Enhance Clinically-Driven Missing Data Recovery Algorithms in Electronic Health Records
by: Lotspeich, Sarah C., et al.
Published: (2025)

Approximate Maximum Likelihood Inference for Acoustic Spatial Capture-Recapture with Unknown Identities, Using Monte Carlo Expectation Maximization
by: Wang, Yuheng, et al.
Published: (2024)