Cover Image

Active Budget Allocation for Efficient Scaling Law Estimation via Surrogate-Guided Pruning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Schram, Viktoria, Hiller, Markus, Beck, Daniel, Cohn, Trevor
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Zero-Shot Performance Prediction for Probabilistic Scaling Laws
by: Schram, Viktoria, et al.
Published: (2025)

Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection
by: Li, Sijie, et al.
Published: (2026)

Efficient Budget Allocation for Large-Scale LLM-Enabled Virtual Screening
by: Li, Zaile, et al.
Published: (2024)

Don't Ignore the Tail: Decoupling top-K Probabilities for Efficient Language Model Distillation
by: Dasgupta, Sayantan, et al.
Published: (2026)

Active Measurement: Efficient Estimation at Scale
by: Hamilton, Max, et al.
Published: (2025)

Time Matters: Scaling Laws for Any Budget
by: Inbar, Itay, et al.
Published: (2024)

A Hitchhiker's Guide to Scaling Law Estimation
by: Choshen, Leshem, et al.
Published: (2024)

Budgeted Online Active Learning with Expert Advice and Episodic Priors
by: Goebel, Kristen, et al.
Published: (2025)

Fine-grained Token Allocation Via Operation Pruning for Efficient MLLMs
by: Liu, Aoming, et al.
Published: (2025)

Towards Multi-Fidelity Scaling Laws of Neural Surrogates in CFD
by: Setinek, Paul, et al.
Published: (2025)

Budgeted Attention Allocation: Cost-Conditioned Compute Control for Efficient Transformers
by: Nidhi, Amrit
Published: (2026)

Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
by: Miao, Ruijie, et al.
Published: (2026)

Adaptive Budget Allocation in LLM-Augmented Surveys
by: Ye, Zikun, et al.
Published: (2026)

Multi-Task Combinatorial Bandits for Budget Allocation
by: Ge, Lin, et al.
Published: (2024)

Capability-Guided Compression: Toward Interpretability-Aware Budget Allocation for Large Language Models
by: Gupta, Rishaank
Published: (2026)

P$^2$ Law: Scaling Law for Post-Training After Model Pruning
by: Chen, Xiaodong, et al.
Published: (2024)

Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
by: Sabry, Mohammed, et al.
Published: (2026)

Knowledge Localization in Mixture-of-Experts LLMs Using Cross-Lingual Inconsistency
by: Bandarkar, Lucas, et al.
Published: (2026)

xLSTM Scaling Laws: Competitive Performance with Linear Time-Complexity
by: Beck, Maximilian, et al.
Published: (2025)

Scaling Laws for Uncertainty in Deep Learning
by: Rosso, Mattia, et al.
Published: (2025)

ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration
by: Hamri, May, et al.
Published: (2026)

Budget Allocation for Unknown Value Functions in a Lipschitz Space
by: Bateni, MohammadHossein, et al.
Published: (2025)

Accelerating PDE Surrogates via RL-Guided Mesh Optimization
by: Meng, Yang, et al.
Published: (2026)

LLM on a Budget: Active Knowledge Distillation for Efficient Classification of Large Text Corpora
by: Luccioli, Viviana, et al.
Published: (2025)

Hallucination Detection on a Budget: Efficient Bayesian Estimation of Semantic Entropy
by: Ciosek, Kamil, et al.
Published: (2025)

Towards Efficient Disaster Response via Cost-effective Unbiased Class Rate Estimation through Neyman Allocation Stratified Sampling Active Learning
by: Bai, Yanbing, et al.
Published: (2024)

The Neural Pruning Law Hypothesis
by: Barbulescu, Eugen, et al.
Published: (2025)

Knapsack RL: Unlocking Exploration of LLMs via Optimizing Budget Allocation
by: Li, Ziniu, et al.
Published: (2025)

TT-Prune: Joint Model Pruning and Resource Allocation for Communication-efficient Time-triggered Federated Learning
by: Zhang, Xinlu, et al.
Published: (2025)

Optimal Perturbation Budget Allocation for Data Poisoning in Offline Reinforcement Learning
by: Qiu, Junnan, et al.
Published: (2025)

BRIDGE: Budget-aware Reasoning via Intermediate Distillation with Guided Examples
by: Le, Xuan-An, et al.
Published: (2025)

Scalable Inference-Time Annealing with Surrogate Likelihood Estimators
by: Peñaherrera, Daniel, et al.
Published: (2026)

Multi-EuP: The Multilingual European Parliament Dataset for Analysis of Bias in Information Retrieval
by: Yang, Jinrui, et al.
Published: (2023)

Foundation-Model Surrogates Enable Data-Efficient Active Learning for Materials Discovery
by: Hu, Jeffrey, et al.
Published: (2026)

Language Model-Driven Data Pruning Enables Efficient Active Learning
by: Azeemi, Abdul Hameed, et al.
Published: (2024)

The Dark Side of Rich Rewards: Understanding and Mitigating Noise in VLM Rewards
by: Huang, Sukai, et al.
Published: (2024)

Power Law Guided Dynamic Sifting for Efficient Attention
by: Koley, Nirav, et al.
Published: (2025)

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
by: Xu, Peng, et al.
Published: (2024)

Online Resource Allocation with Average Budget Constraints
by: Ao, Ruicheng, et al.
Published: (2024)

Direct Acquisition Optimization for Low-Budget Active Learning
by: Zhao, Zhuokai, et al.
Published: (2024)