Cover Image

Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ferreira, Fabio, Wobbe, Lucca, Krishnakumar, Arjun, Hutter, Frank, Zela, Arber
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Objective Hierarchical Optimization with Large Language Models
by: Schwanke, Andrej, et al.
Published: (2026)

Towards Scaling Laws for Symbolic Regression
by: Otte, David, et al.
Published: (2025)

Improving LLM-based Global Optimization with Search Space Partitioning
by: Schwanke, Andrej, et al.
Published: (2025)

TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting
by: Moroshan, Vladyslav, et al.
Published: (2025)

Regularized Neural Ensemblers
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Ensembling Finetuned Language Models for Text Classification
by: Arango, Sebastian Pineda, et al.
Published: (2024)

GAMformer: Bridging Tabular Foundation Models and Interpretable Machine Learning
by: Mueller, Andreas, et al.
Published: (2024)

DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products
by: Siems, Julien, et al.
Published: (2025)

Multi-objective Differentiable Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Weight-Entanglement Meets Gradient-Based Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2023)

Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues
by: Grazzi, Riccardo, et al.
Published: (2024)

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization
by: Watanabe, Shuhei, et al.
Published: (2022)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
by: Rakotoarison, Herilalaina, et al.
Published: (2024)

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Multi-objective Hyperparameter Optimization in the Age of Deep Learning
by: Basu, Soham, et al.
Published: (2025)

Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization
by: Carstensen, Timur, et al.
Published: (2025)

Practitioner Motives to Use Different Hyperparameter Optimization Methods
by: Kannengießer, Niclas, et al.
Published: (2022)

confopt: A Library for Implementation and Evaluation of Gradient-based One-Shot NAS Methods
by: Jha, Abhash Kumar, et al.
Published: (2025)

Evolving Many Worlds: Towards Open-Ended Discovery in Petri Dish NCA via Population-Based Training
by: Berdica, Uljad, et al.
Published: (2026)

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator
by: Watanabe, Shuhei, et al.
Published: (2022)

ARLBench: Flexible and Efficient Benchmarking for Hyperparameter Optimization in Reinforcement Learning
by: Becktepe, Jannis, et al.
Published: (2024)

Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features
by: Dunbar, Oliver R. A., et al.
Published: (2024)

Agentic-imodels: Evolving agentic interpretability tools via autoresearch
by: Singh, Chandan, et al.
Published: (2026)

Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
by: Nagler, Thomas, et al.
Published: (2024)

carps: A Framework for Comparing N Hyperparameter Optimizers on M Benchmarks
by: Benjamins, Carolin, et al.
Published: (2025)

Substance Beats Style: Why Beginning Students Fail to Code with LLMs
by: Lucchetti, Francesca, et al.
Published: (2024)

Learning Algorithm Hyperparameters for Fast Parametric Convex Optimization
by: Sambharya, Rajiv, et al.
Published: (2024)

Hyperparameter Optimization Can Even be Harmful in Off-Policy Learning and How to Deal with It
by: Saito, Yuta, et al.
Published: (2024)

Exploring the Optimized Value of Each Hyperparameter in Various Gradient Descent Algorithms
by: Chen, Abel C. H.
Published: (2022)

Overtuning in Hyperparameter Optimization
by: Schneider, Lennart, et al.
Published: (2025)

A General Framework for User-Guided Bayesian Optimization
by: Hvarfner, Carl, et al.
Published: (2023)

Selecting Hyperparameters for Tree-Boosting
by: Koster, Floris Jan, et al.
Published: (2026)

Hyperparameter Optimization in Machine Learning
by: Franceschi, Luca, et al.
Published: (2024)

HO-FMN: Hyperparameter Optimization for Fast Minimum-Norm Attacks
by: Mura, Raffaele, et al.
Published: (2024)

Stochastic Optimization Algorithms for Instrumental Variable Regression with Streaming Data
by: Chen, Xuxing, et al.
Published: (2024)

Bayesian Optimization for Simultaneous Selection of Machine Learning Algorithms and Hyperparameters on Shared Latent Space
by: Ishikawa, Kazuki, et al.
Published: (2025)

Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
by: Fehring, Lukas, et al.
Published: (2025)

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How
by: Arango, Sebastian Pineda, et al.
Published: (2023)

HyperArm Bandit Optimization: A Novel approach to Hyperparameter Optimization and an Analysis of Bandit Algorithms in Stochastic and Adversarial Settings
by: Karroum, Samih, et al.
Published: (2025)

One-shot World Models Using a Transformer Trained on a Synthetic Prior
by: Ferreira, Fabio, et al.
Published: (2024)