Cover Image

Efficient Prediction of Pass@k Scaling in Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kazdan, Joshua, Schaeffer, Rylan, Allouah, Youssef, Sullivan, Colin, Yu, Kyssen, Levi, Noam, Koyejo, Sanmi
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning Applications
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Position: Model Collapse Does Not Mean What You Think
by: Schaeffer, Rylan, et al.
Published: (2025)

Scale Dependent Data Duplication
by: Kazdan, Joshua, et al.
Published: (2026)

Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeed
by: Gupta, Isha, et al.
Published: (2025)

Pretraining Scaling Laws for Generative Evaluations of Language Models
by: Schaeffer, Rylan, et al.
Published: (2025)

The Utility and Complexity of in- and out-of-Distribution Machine Unlearning
by: Allouah, Youssef, et al.
Published: (2024)

Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating World
by: Kazdan, Joshua, et al.
Published: (2024)

Consensus is Not Verification: Why Crowd Wisdom Strategies Fail for LLM Truthfulness
by: Denisov-Blanch, Yegor, et al.
Published: (2026)

How Do Large Language Monkeys Get Their Power (Laws)?
by: Schaeffer, Rylan, et al.
Published: (2025)

No, of Course I Can! Deeper Fine-Tuning Attacks That Bypass Token-Level Safety Mechanisms
by: Kazdan, Joshua, et al.
Published: (2025)

KGGen: Extracting Knowledge Graphs from Plain Text with Language Models
by: Mo, Belinda, et al.
Published: (2025)

Reliable and Efficient Amortized Model-based Evaluation
by: Truong, Sang, et al.
Published: (2025)

Surrogate-Based Prevalence Measurement for Large-Scale A/B Testing
by: Xu, Zehao, et al.
Published: (2026)

Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data
by: Miranda, Brando, et al.
Published: (2023)

Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
by: Schaeffer, Rylan, et al.
Published: (2024)

Investigating Data Contamination for Pre-training Language Models
by: Jiang, Minhao, et al.
Published: (2024)

AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems
by: Hardy, Michael, et al.
Published: (2026)

What Causes Polysemanticity? An Alternative Origin Story of Mixed Selectivity from Incidental Causes
by: Lecomte, Victor, et al.
Published: (2023)

Efficient Detection of Bad Benchmark Items with Novel Scalability Coefficients
by: Hardy, Michael, et al.
Published: (2026)

Performance Evaluation of Large Language Models in Statistical Programming
by: Song, Xinyi, et al.
Published: (2025)

Distributional Machine Unlearning via Selective Data Removal
by: Allouah, Youssef, et al.
Published: (2025)

Subnational Geocoding of Global Disasters Using Large Language Models
by: Ronco, Michele, et al.
Published: (2025)

ZIP-FIT: Embedding-Free Data Selection via Compression-Based Alignment
by: Obbad, Elyas, et al.
Published: (2024)

Evaluating the Robustness of Chinchilla Compute-Optimal Scaling
by: Schaeffer, Rylan, et al.
Published: (2025)

StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis
by: Song, Xinyi, et al.
Published: (2025)

Evaluating the Use of Large Language Models as Synthetic Social Agents in Social Science Research
by: Madden, Emma Rose
Published: (2025)

In-Context Learning of Energy Functions
by: Schaeffer, Rylan, et al.
Published: (2024)

Large Language Model Predicts Above Normal All India Summer Monsoon Rainfall in 2024
by: Sharma, Ujjawal, et al.
Published: (2024)

Min-p, Max Exaggeration: A Critical Analysis of Min-p Sampling in Language Models
by: Schaeffer, Rylan, et al.
Published: (2025)

From Passive Metric to Active Signal: The Evolving Role of Uncertainty Quantification in Large Language Models
by: Zhang, Jiaxin, et al.
Published: (2026)

AI for Handball: predicting and explaining the 2024 Olympic Games tournament with Deep Learning and Large Language Models
by: Felice, Florian
Published: (2024)

Domain-Shift-Aware Conformal Prediction for Large Language Models
by: Lin, Zhexiao, et al.
Published: (2025)

Quantifying Variance in Evaluation Benchmarks
by: Madaan, Lovish, et al.
Published: (2024)

TCKAN:A Novel Integrated Network Model for Predicting Mortality Risk in Sepsis Patients
by: Dong, Fanglin
Published: (2024)

Decision Quality Evaluation Framework at Pinterest
by: Tian, Yuqi, et al.
Published: (2026)

Predictive Scale-Bridging Simulations through Active Learning
by: Karra, Satish, et al.
Published: (2022)

Augmented Risk Prediction for the Onset of Alzheimer's Disease from Electronic Health Records with Large Language Models
by: Wang, Jiankun, et al.
Published: (2024)

Estimating Item Difficulty with Large Language Models as Experts
by: Kolesnikova, Diana, et al.
Published: (2026)

Sharpe Ratio-Guided Active Learning for Preference Optimization in RLHF
by: Belakaria, Syrine, et al.
Published: (2025)

Continuously Optimizing Radar Placement with Model Predictive Path Integrals
by: Potter, Michael, et al.
Published: (2024)

A Simple Model of Inference Scaling Laws
by: Levi, Noam
Published: (2024)