Imagen de Portada

Efficient Detection of Bad Benchmark Items with Novel Scalability Coefficients

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hardy, Michael, Gilbert, Joshua, Domingue, Benjamin
Formato:	Preprint
Publicado:	2026
Materias:	Applications Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems
por: Hardy, Michael, et al.
Publicado: (2026)

"All that Glitters": Approaches to Evaluations with Unreliable Model and Human Annotations
por: Hardy, Michael
Publicado: (2024)

Scalable Stewardship of an LLM-Assisted Clinical Benchmark with Physician Oversight
por: Ye, Junze, et al.
Publicado: (2025)

Predicting Bad Goods Risk Scores with ARIMA Time Series: A Novel Risk Assessment Approach
por: Gond, Bishwajit Prasad
Publicado: (2025)

Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact
por: Hardy, Michael, et al.
Publicado: (2026)

SEED-SET: Scalable Evolving Experimental Design for System-level Ethical Testing
por: Parashar, Anjali, et al.
Publicado: (2026)

Estimating Item Difficulty with Large Language Models as Experts
por: Kolesnikova, Diana, et al.
Publicado: (2026)

Predicting the Skies: A Novel Model for Flight-Level Passenger Traffic Forecasting
por: Ehsani, Sina, et al.
Publicado: (2024)

Integrating Dynamic Correlation Shifts and Weighted Benchmarking in Extreme Value Analysis
por: Panagoulias, Dimitrios P., et al.
Publicado: (2024)

TCKAN:A Novel Integrated Network Model for Predicting Mortality Risk in Sepsis Patients
por: Dong, Fanglin
Publicado: (2024)

Efficient Prediction of Pass@k Scaling in Large Language Models
por: Kazdan, Joshua, et al.
Publicado: (2025)

Dynamic Bayesian Item Response Model with Decomposition (D-BIRD): Modeling Cohort and Individual Learning Over Time
por: Lee, Hansol, et al.
Publicado: (2025)

Classification Modeling with RNN-Based, Random Forest, and XGBoost for Imbalanced Data: A Case of Early Crash Detection in ASEAN-5 Stock Markets
por: Siswara, Deri, et al.
Publicado: (2024)

Scalable Spatiotemporal Prediction with Bayesian Neural Fields
por: Saad, Feras, et al.
Publicado: (2024)

Towards Reliable LLM Evaluation: Correcting the Winner's Curse in Adaptive Benchmarking
por: Xu, Yang, et al.
Publicado: (2026)

Quantitative Technology Forecasting: a Review of Trend Extrapolation Methods
por: Tsai, Peng-Hung, et al.
Publicado: (2024)

A Distribution-Free Framework for Rewrite-Based Human-text Detection via Knockoff Filtering
por: Liu, Yi
Publicado: (2026)

Feature Group Tabular Transformer: A Novel Approach to Traffic Crash Modeling and Causality Analysis
por: Lares, Oscar, et al.
Publicado: (2024)

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning
por: Jin, Congyun, et al.
Publicado: (2024)

AI for Anticipatory Action: Moving Beyond Climate Forecasting
por: Huynh, Benjamin Q., et al.
Publicado: (2023)

Multi-scale Masked Autoencoder for Electrocardiogram Anomaly Detection
por: Zhou, Ya, et al.
Publicado: (2025)

Continuously Optimizing Radar Placement with Model Predictive Path Integrals
por: Potter, Michael, et al.
Publicado: (2024)

Survival Analysis with Adversarial Regularization
por: Potter, Michael, et al.
Publicado: (2023)

TowerDebias: A Novel Unfairness Removal Method Based on the Tower Property
por: Matloff, Norman, et al.
Publicado: (2024)

Decision Quality Evaluation Framework at Pinterest
por: Tian, Yuqi, et al.
Publicado: (2026)

Surrogate-Based Prevalence Measurement for Large-Scale A/B Testing
por: Xu, Zehao, et al.
Publicado: (2026)

Rectification Difficulty and Optimal Sample Allocation in LLM-Augmented Surveys
por: Ye, Zikun, et al.
Publicado: (2026)

CERES: A Probabilistic Early Warning System for Acute Food Insecurity
por: Pedersen, Tom Danny S.
Publicado: (2026)

From Passive Metric to Active Signal: The Evolving Role of Uncertainty Quantification in Large Language Models
por: Zhang, Jiaxin, et al.
Publicado: (2026)

Binary Gaussian Copula Synthesis: A Novel Data Augmentation Technique to Advance ML-based Clinical Decision Support Systems for Early Prediction of Dialysis Among CKD Patients
por: Khosravi, Hamed, et al.
Publicado: (2024)

On the Mechanistic Interpretability of Neural Networks for Causality in Bio-statistics
por: Conan, Jean-Baptiste A.
Publicado: (2025)

StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis
por: Song, Xinyi, et al.
Publicado: (2025)

HiBayES: A Hierarchical Bayesian Modeling Framework for AI Evaluation Statistics
por: Luettgau, Lennart, et al.
Publicado: (2025)

Data-Driven Bayesian Network Models of Hurricane Evacuation Decision Making
por: Wang, Hui Sophie, et al.
Publicado: (2023)

Decade-long Emission Forecasting with an Ensemble Model in Taiwan
por: Hung, Gordon, et al.
Publicado: (2025)

ChatGPT and post-test probability
por: Weisenthal, Samuel J.
Publicado: (2023)

Process-Aware Analysis of Treatment Paths in Heart Failure Patients: A Case Study
por: Beyel, Harry H., et al.
Publicado: (2024)

Calculating Customer Lifetime Value and Churn using Beta Geometric Negative Binomial and Gamma-Gamma Distribution in a NFT based setting
por: Das, Sagarnil
Publicado: (2025)

Unlocking the Potential of Past Research: Using Generative AI to Reconstruct Healthcare Simulation Models
por: Monks, Thomas, et al.
Publicado: (2025)

The Advancement of Personalized Learning Potentially Accelerated by Generative AI
por: Wei, Yuang, et al.
Publicado: (2024)