Cover Image

Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Polo, Felipe Maia, Somerstep, Seamus, Choshen, Leshem, Sun, Yuekai, Yurochkin, Mikhail
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

tinyBenchmarks: evaluating LLMs with fewer examples
by: Polo, Felipe Maia, et al.
Published: (2024)

Efficient multi-prompt evaluation of LLMs
by: Polo, Felipe Maia, et al.
Published: (2024)

Weak Supervision Performance Evaluation via Partial Identification
by: Polo, Felipe Maia, et al.
Published: (2023)

A transfer learning framework for weak-to-strong generalization
by: Somerstep, Seamus, et al.
Published: (2024)

Bridging Human and LLM Judgments: Understanding and Narrowing the Gap
by: Polo, Felipe Maia, et al.
Published: (2025)

A Latent Variable Framework for Scaling Laws in Large Language Models
by: Cai, Peiyao, et al.
Published: (2025)

Limitations of refinement methods for weak to strong generalization
by: Somerstep, Seamus, et al.
Published: (2025)

Microfoundation Inference for Strategic Prediction
by: Bracale, Daniele, et al.
Published: (2024)

Algorithmic Fairness in Performative Policy Learning: Escaping the Impossibility of Group Fairness
by: Somerstep, Seamus, et al.
Published: (2024)

Learning In Reverse Causal Strategic Environments With Ramifications on Two Sided Markets
by: Somerstep, Seamus, et al.
Published: (2024)

Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead
by: Brüel-Gabrielsson, Rickard, et al.
Published: (2024)

Aligners: Decoupling LLMs and Alignment
by: Ngweta, Lilian, et al.
Published: (2024)

Learning to Choose or Choosing to Learn: Best-of-N vs. Supervised Fine-Tuning for Bit String Generation
by: Somerstep, Seamus, et al.
Published: (2025)

A Hitchhiker's Guide to Scaling Law Estimation
by: Choshen, Leshem, et al.
Published: (2024)

Fuse to Forget: Bias Reduction and Selective Memorization through Model Fusion
by: Zaman, Kerem, et al.
Published: (2023)

Fusing Models with Complementary Expertise
by: Wang, Hongyi, et al.
Published: (2023)

ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization
by: Yadav, Prateek, et al.
Published: (2023)

CARROT: A Cost Aware Rate Optimal Router
by: Somerstep, Seamus, et al.
Published: (2025)

How predictable is language model benchmark performance?
by: Owen, David
Published: (2024)

Robustness as an Emergent Property of Task Performance
by: Ashury-Tahan, Shir, et al.
Published: (2026)

Out-of-Distribution Detection using Synthetic Data Generation
by: Abbas, Momin, et al.
Published: (2025)

Resolving Interference (RI): Disentangling Models for Improved Model Merging
by: Ramesh, Pratik, et al.
Published: (2026)

Prompt Exploration with Prompt Regression
by: Feffer, Michael, et al.
Published: (2024)

TextArena
by: Guertler, Leon, et al.
Published: (2025)

Beyond Binary Rewards: Training LMs to Reason About Their Uncertainty
by: Damani, Mehul, et al.
Published: (2025)

Uncertainty Quantification via Stable Distribution Propagation
by: Petersen, Felix, et al.
Published: (2024)

Automated discovery of symbolic laws governing skill acquisition from naturally occurring data
by: Liu, Sannyuya, et al.
Published: (2024)

Genie: Achieving Human Parity in Content-Grounded Datasets Generation
by: Yehudai, Asaf, et al.
Published: (2024)

Rich Insights from Cheap Signals: Efficient Evaluations via Tensor Factorization
by: Polo, Felipe Maia, et al.
Published: (2026)

Personalized Image Generation for Recommendations Beyond Catalogs
by: Patron, Gabriel, et al.
Published: (2025)

A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning
by: Yadav, Prateek, et al.
Published: (2024)

Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMs
by: Ifergan, Maxim, et al.
Published: (2024)

Comprehensive benchmarking of large language models for RNA secondary structure prediction
by: Zablocki, L. I., et al.
Published: (2024)

Springdrift: An Auditable Persistent Runtime for LLM Agents with Case-Based Memory, Normative Safety, and Ambient Self-Perception
by: Brady, Seamus
Published: (2026)

Do LLMs Benefit From Their Own Words?
by: Huang, Jenny Y., et al.
Published: (2026)

What drives performance in molecular MPNNs? An operator-level factorial benchmark
by: Jiao, Panyu, et al.
Published: (2026)

ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models
by: Ashury-Tahan, Shir, et al.
Published: (2026)

PSBench: a large-scale benchmark for estimating the accuracy of protein complex structural models
by: Neupane, Pawan, et al.
Published: (2025)

Agent psychometrics: Task-level performance prediction in agentic coding benchmarks
by: Ge, Chris, et al.
Published: (2026)

Neural Architecture Search using Particle Swarm and Ant Colony Optimization
by: Lankford, Séamus, et al.
Published: (2024)