Cover Image

ACES: Who Tests the Tests? Leave-One-Out AUC Consistency for Code Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Hui, Zhang, Yun-Ji, Xie, Zheng, Liu, Ren-Biao, Du, Yali, Li, Xin-Ye, Li, Ming
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring Pass-Rate Reward in Reinforcement Learning for Code Generation
by: Li, Xin-Ye, et al.
Published: (2026)

Post-Incorporating Code Structural Knowledge into Pretrained Models via ICL for Code Translation
by: Du, Yali, et al.
Published: (2025)

Weakly Supervised AUC Optimization: A Unified Partial AUC Approach
by: Xie, Zheng, et al.
Published: (2023)

Design-Specification Tiling for ICL-based CAD Code Generation
by: Du, Yali, et al.
Published: (2026)

A Joint Learning Model with Variational Interaction for Multilingual Program Translation
by: Du, Yali, et al.
Published: (2024)

Top Pass: Improve Code Generation by Pass@k-Maximized Code Ranking
by: Lyu, Zhi-Cun, et al.
Published: (2024)

Leave-One-Out Prediction for General Hypothesis Classes
by: Qian, Jian, et al.
Published: (2026)

An Iterative Test-and-Repair Framework for Competitive Code Generation
by: Tang, Lingxiao, et al.
Published: (2026)

ACES: Accent Subspaces for Coupling, Explanations, and Stress-Testing in Automatic Speech Recognition
by: Parekh, Swapnil
Published: (2026)

Evaluating the Test Adequacy of Benchmarks for LLMs on Code Generation
by: Xiangyue Liu, et al.
Published: (2025)

Weighted Leave-One-Out Cross Validation
by: Pronzato, Luc, et al.
Published: (2025)

Leave-One-Out Stable Conformal Prediction
by: Lee, Kiljae, et al.
Published: (2025)

Leave-One-Out Learning with Log-Loss
by: Fogel, Yaniv, et al.
Published: (2025)

Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs
by: Li, Ziyu, et al.
Published: (2024)

Asymptotically Optimal Tests for One- and Two-Sample Problems
by: Grootveld, Arick, et al.
Published: (2026)

Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis
by: Zhu, Haonan, et al.
Published: (2026)

Enhancing LLMs in Long Code Translation through Instrumentation and Program State Alignment
by: Xin-Ye, Li, et al.
Published: (2025)

OODD: Test-time Out-of-Distribution Detection with Dynamic Dictionary
by: Yang, Yifeng, et al.
Published: (2025)

CodeContests+: High-Quality Test Case Generation for Competitive Programming
by: Wang, Zihan, et al.
Published: (2025)

MUCOCO: Automated Consistency Testing of Code LLMs
by: Chou, Chua Jin, et al.
Published: (2026)

When LRP Diverges from Leave-One-Out in Transformers
by: You, Weiqiu, et al.
Published: (2025)

Leave-One-Out-, Bootstrap- and Cross-Conformal Anomaly Detectors
by: Hennhöfer, Oliver, et al.
Published: (2024)

Leave-One-Out Analysis for Nonconvex Robust Matrix Completion with General Thresholding Functions
by: Wang, Tianming, et al.
Published: (2024)

S*: Test Time Scaling for Code Generation
by: Li, Dacheng, et al.
Published: (2025)

Interval-Based AUC (iAUC): Extending ROC Analysis to Uncertainty-Aware Classification
by: Li, Yuqi, et al.
Published: (2026)

ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generation
by: Deng, Chenhui, et al.
Published: (2025)

Navigating Pharmacogenomic Testing in Practice: Who to Test and When to Test
by: James M. Stevenson, et al.
Published: (2025)

ACES: Generating Diverse Programming Puzzles with with Autotelic Generative Models
by: Pourcel, Julien, et al.
Published: (2023)

Measuring the Influence of Incorrect Code on Test Generation
by: Huang, Dong, et al.
Published: (2024)

Who Wrote this Code? Watermarking for Code Generation
by: Lee, Taehyun, et al.
Published: (2023)

Klear-CodeTest: Scalable Test Case Generation for Code Reinforcement Learning
by: Fu, Jia, et al.
Published: (2025)

Generalizing Test Cases for Comprehensive Test Scenario Coverage
by: Qi, Binhang, et al.
Published: (2026)

Cross-validating causal discovery via Leave-One-Variable-Out
by: Schkoda, Daniela, et al.
Published: (2024)

Lares: LLM-driven Code Slice Semantic Search for Patch Presence Testing
by: Li, Siyuan, et al.
Published: (2025)

MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluation
by: Wang, Yutong, et al.
Published: (2025)

Leaving No One Behind, Leaving No One Unaccountable
by: Glušac, Luka
Published: (2023)

VeriScale: Adversarial Test-Suite Scaling for Verifiable Code Generation
by: Bai, Yifan, et al.
Published: (2026)

Preserving AUC Fairness in Learning with Noisy Protected Groups
by: Wu, Mingyang, et al.
Published: (2025)

Confidence Intervals for AUC and pAUC by Empirical Likelihood
by: Yumin Zhao, et al.
Published: (2025)

Test-time GNN Model Evaluation on Dynamic Graphs
by: Li, Bo, et al.
Published: (2025)