Cover Image

Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Watanabe, Shuhei, Mallik, Neeratyoy, Bergman, Edward, Hutter, Frank
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization
by: Carstensen, Timur, et al.
Published: (2025)

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization
by: Watanabe, Shuhei, et al.
Published: (2022)

Fast Optimizer Benchmark
by: Blauth, Simon, et al.
Published: (2024)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
by: Rakotoarison, Herilalaina, et al.
Published: (2024)

Approximation of Box Decomposition Algorithm for Fast Hypervolume-Based Multi-Objective Optimization
by: Watanabe, Shuhei
Published: (2025)

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator
by: Watanabe, Shuhei, et al.
Published: (2022)

Warmstarting for Scaling Language Models
by: Mallik, Neeratyoy, et al.
Published: (2024)

LMEMs for post-hoc analysis of HPO Benchmarking
by: Geburek, Anton, et al.
Published: (2024)

Don't Waste Your Time: Early Stopping Cross-Validation
by: Bergman, Edward, et al.
Published: (2024)

Derivation of Output Correlation Inferences for Multi-Output (aka Multi-Task) Gaussian Process
by: Watanabe, Shuhei
Published: (2025)

Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objective
by: Watanabe, Shuhei
Published: (2024)

Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance
by: Watanabe, Shuhei
Published: (2023)

Batch Acquisition Function Evaluations and Decouple Optimizer Updates for Faster Bayesian Optimization
by: Irie, Kaichi, et al.
Published: (2025)

OptunaHub: A Platform for Black-Box Optimization
by: Ozaki, Yoshihiko, et al.
Published: (2025)

Agentic NL2SQL to Reduce Computational Costs
by: Jehle, Dominik, et al.
Published: (2025)

Tree-Structured Parzen Estimator Can Solve Black-Box Combinatorial Optimization More Efficiently
by: Abe, Kenshin, et al.
Published: (2025)

Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation
by: Lee, Dong Bok, et al.
Published: (2024)

carps: A Framework for Comparing N Hyperparameter Optimizers on M Benchmarks
by: Benjamins, Carolin, et al.
Published: (2025)

Light-Weight Benchmarks Reveal the Hidden Hardware Cost of Zero-Shot Tabular Foundation Models
by: Gangwani, Ishaan, et al.
Published: (2025)

TabArena: A Living Benchmark for Machine Learning on Tabular Data
by: Erickson, Nick, et al.
Published: (2025)

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Tuning LLM Judge Design Decisions for 1/1000 of the Cost
by: Salinas, David, et al.
Published: (2025)

Zero-shot Meta-learning for Tabular Prediction Tasks with Adversarially Pre-trained Transformer
by: Wu, Yulun, et al.
Published: (2025)

Conditional PED-ANOVA: Hyperparameter Importance in Hierarchical & Dynamic Search Spaces
by: Baba, Kaito, et al.
Published: (2026)

TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting
by: Moroshan, Vladyslav, et al.
Published: (2025)

Multi-Objective Multi-Fidelity Bayesian Optimization with Causal Priors
by: Hossen, Md Abir, et al.
Published: (2026)

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models
by: Bhethanabhotla, Sathya Kamesh, et al.
Published: (2024)

Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patients
by: Berger, Armin, et al.
Published: (2025)

Time Series Foundation Models for Energy Load Forecasting on Consumer Hardware: A Multi-Dimensional Zero-Shot Benchmark
by: Simeone, Luigi
Published: (2026)

Benchmarking the State of Networks with a Low-Cost Method Based on Reservoir Computing
by: Reimers, Felix Simon, et al.
Published: (2025)

When is Warmstarting Effective for Scaling Language Models?
by: Mallik, Neeratyoy, et al.
Published: (2026)

A Backdoor-based Explainable AI Benchmark for High Fidelity Evaluation of Attributions
by: Yang, Peiyu, et al.
Published: (2024)

Efficient Search for Customized Activation Functions with Gradient Descent
by: Strack, Lukas, et al.
Published: (2024)

Large Language Models Engineer Too Many Simple Features For Tabular Data
by: Küken, Jaris, et al.
Published: (2024)

EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks
by: Arbel, Michael, et al.
Published: (2025)

Adaptive Multi-Fidelity Reinforcement Learning for Variance Reduction in Engineering Design Optimization
by: Agrawal, Akash, et al.
Published: (2025)

Self-Tuning Sparse Attention: Multi-Fidelity Hyperparameter Optimization for Transformer Acceleration
by: Dev, Arundhathi, et al.
Published: (2026)

AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
by: De Brouwer, Edward, et al.
Published: (2026)

FastKernels: Benchmarking GPU Kernel Generation in Production
by: Oliaro, Gabriele, et al.
Published: (2026)

DABstep: Data Agent Benchmark for Multi-step Reasoning
by: Egg, Alex, et al.
Published: (2025)