Improving LLM-based Global Optimization with Search Space Partitioning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Schwanke, Andrej, Ivanov, Lyubomir, Salinas, David, Ferreira, Fabio, Klein, Aaron, Hutter, Frank, Zela, Arber
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Objective Hierarchical Optimization with Large Language Models
by: Schwanke, Andrej, et al.
Published: (2026)

TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting
by: Moroshan, Vladyslav, et al.
Published: (2025)

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Evolving Many Worlds: Towards Open-Ended Discovery in Petri Dish NCA via Population-Based Training
by: Berdica, Uljad, et al.
Published: (2026)

Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
by: Ferreira, Fabio, et al.
Published: (2026)

Tuning LLM Judge Design Decisions for 1/1000 of the Cost
by: Salinas, David, et al.
Published: (2025)

Towards Scaling Laws for Symbolic Regression
by: Otte, David, et al.
Published: (2025)

EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks
by: Arbel, Michael, et al.
Published: (2025)

TabArena: A Living Benchmark for Machine Learning on Tabular Data
by: Erickson, Nick, et al.
Published: (2025)

Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models
by: Bhethanabhotla, Sathya Kamesh, et al.
Published: (2024)

GAMformer: Bridging Tabular Foundation Models and Interpretable Machine Learning
by: Mueller, Andreas, et al.
Published: (2024)

Multi-objective Differentiable Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Multi-Objective Neural Architecture Search by Learning Search Space Partitions
by: Zhao, Yiyang, et al.
Published: (2024)

Efficient Search for Customized Activation Functions with Gradient Descent
by: Strack, Lukas, et al.
Published: (2024)

DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products
by: Siems, Julien, et al.
Published: (2025)

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization
by: Watanabe, Shuhei, et al.
Published: (2022)

One-shot World Models Using a Transformer Trained on a Synthetic Prior
by: Ferreira, Fabio, et al.
Published: (2024)

Multi-objective Optimization by Learning Space Partitions
by: Zhao, Yiyang, et al.
Published: (2021)

Warmstarting for Scaling Language Models
by: Mallik, Neeratyoy, et al.
Published: (2024)

Weight-Entanglement Meets Gradient-Based Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2023)

Partition Tree Weighting for Non-Stationary Stochastic Bandits
by: Veness, Joel, et al.
Published: (2025)

Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization
by: Carstensen, Timur, et al.
Published: (2025)

OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems
by: Li, Xiaozhe, et al.
Published: (2025)

Fast Benchmarking of Asynchronous Multi-Fidelity Optimization on Zero-Cost Benchmarks
by: Watanabe, Shuhei, et al.
Published: (2024)

Fast Optimizer Benchmark
by: Blauth, Simon, et al.
Published: (2024)

Regularized Neural Ensemblers
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Increasing LLM Coding Capabilities through Diverse Synthetic Coding Tasks
by: Abed, Amal, et al.
Published: (2025)

Sample-Efficient Bayesian Optimization with Transfer Learning for Heterogeneous Search Spaces
by: Deshwal, Aryan, et al.
Published: (2024)

Monte Carlo Tree Search based Space Transfer for Black-box Optimization
by: Wang, Shukuan, et al.
Published: (2024)

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator
by: Watanabe, Shuhei, et al.
Published: (2022)

Levin Tree Search with Context Models
by: Orseau, Laurent, et al.
Published: (2023)

Hyperband-based Bayesian Optimization for Black-box Prompt Selection
by: Schneider, Lennart, et al.
Published: (2024)

Ensembling Finetuned Language Models for Text Classification
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Transfer Learning for Bayesian Optimization on Heterogeneous Search Spaces
by: Fan, Zhou, et al.
Published: (2023)

Agentic NL2SQL to Reduce Computational Costs
by: Jehle, Dominik, et al.
Published: (2025)

Large Language Models Engineer Too Many Simple Features For Tabular Data
by: Küken, Jaris, et al.
Published: (2024)

Don't Waste Your Time: Early Stopping Cross-Validation
by: Bergman, Edward, et al.
Published: (2024)

Enhancing LLM-based Search Agents via Contribution Weighted Group Relative Policy Optimization
by: Wang, Junzhe, et al.
Published: (2026)

Combinatorial Optimization with Policy Adaptation using Latent Space Search
by: Chalumeau, Felix, et al.
Published: (2023)

Position: The Future of Bayesian Prediction Is Prior-Fitted
by: Müller, Samuel, et al.
Published: (2025)