Cover Image

Auto Researching, not hyperparameter tuning: Convergence Analysis of 10,000 Experiments

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Li, Xiaoyi
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Training neural networks faster with minimal tuning using pre-computed lists of hyperparameters for NAdamW
by: Medapati, Sourabh, et al.
Published: (2025)

Be aware of overfitting by hyperparameter optimization!
by: Tetko, Igor V., et al.
Published: (2024)

Neural Velocity for hyperparameter tuning
by: Dalmasso, Gianluca, et al.
Published: (2025)

$μ$pscaling small models: Principled warm starts and hyperparameter transfer
by: Ma, Yuxin, et al.
Published: (2026)

Faster Convergence for Transformer Fine-tuning with Line Search Methods
by: Kenneweg, Philip, et al.
Published: (2024)

Compiler-R1: Towards Agentic Compiler Auto-tuning with Reinforcement Learning
by: Pan, Haolin, et al.
Published: (2025)

Fuzzy hyperparameters update in a second order optimization
by: Bensadok, Abdelaziz, et al.
Published: (2024)

Do Post-Training Algorithms Actually Differ? A Controlled Study Across Model Scales Uncovers Scale-Dependent Ranking Inversions
by: Li, Xiaoyi
Published: (2026)

The Stabilizer Bootstrap of Quantum Machine Learning with up to 10000 qubits
by: Li, Yuqing, et al.
Published: (2024)

AutoLoop: Fast Visual SLAM Fine-tuning through Agentic Curriculum Learning
by: Lahiany, Assaf, et al.
Published: (2025)

Adaptation of XAI to Auto-tuning for Numerical Libraries
by: Aoki, Shota, et al.
Published: (2024)

AutoCLIP: Auto-tuning Zero-Shot Classifiers for Vision-Language Models
by: Metzen, Jan Hendrik, et al.
Published: (2023)

An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters
by: Keisler, Julie, et al.
Published: (2023)

Hyperparameter Importance Analysis for Multi-Objective AutoML
by: Theodorakopoulos, Daphne, et al.
Published: (2024)

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
by: Huang, Wei, et al.
Published: (2026)

LLM-AutoSciLab: Closed-Loop Scientific Discovery via Active Experimentation with LLMs
by: Kabra, Sanchit, et al.
Published: (2026)

A Convergence Analysis of Adaptive Optimizers under Floating-point Quantization
by: Tang, Xuan, et al.
Published: (2025)

AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models
by: Tang, Zhiqiang, et al.
Published: (2024)

AutoOR: Scalably Post-training LLMs to Autoformalize Operations Research Problems
by: Motwani, Sumeet Ramesh, et al.
Published: (2026)

Learning Theory of the SVRG: Generalization and Convergence Analysis
by: Lei, Yunwen, et al.
Published: (2026)

AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive
by: Guo, Taicheng, et al.
Published: (2026)

Transformer-based Parameter Fitting of Models derived from Bloch-McConnell Equations for CEST MRI Analysis
by: Duhme, Christof, et al.
Published: (2026)

Multimodal hierarchical Variational AutoEncoders with Factor Analysis latent space
by: Guerrero-López, Alejandro, et al.
Published: (2022)

Auto-Prompt Ensemble for LLM Judge
by: Li, Jiajie, et al.
Published: (2025)

EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents
by: Liu, Jiaqi, et al.
Published: (2026)

Finite-time Convergence Analysis of Actor-Critic with Evolving Reward
by: Hu, Rui, et al.
Published: (2025)

Learning from models beyond fine-tuning
by: Zheng, Hongling, et al.
Published: (2023)

Auto-Unrolled Proximal Gradient Descent: An AutoML Approach to Interpretable Waveform Optimization
by: Kaplan, Ahmet
Published: (2026)

Decentralized Domain Generalization with Style Sharing: Formal Model and Convergence Analysis
by: Zehtabi, Shahryar, et al.
Published: (2025)

Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees
by: Wang, Cangqing, et al.
Published: (2024)

Speculative Coreset Selection for Task-Specific Fine-tuning
by: Zhang, Xiaoyu, et al.
Published: (2024)

Exploring Sparsity and Smoothness of Arbitrary $\ell_p$ Norms in Adversarial Attacks
by: Duhme, Christof, et al.
Published: (2026)

Perturbing the Phase: Analyzing Adversarial Robustness of Complex-Valued Neural Networks
by: Eilers, Florian, et al.
Published: (2026)

Convergence Analysis of Aggregation-Broadcast in LoRA-enabled Distributed Fine-Tuning
by: Chen, Xin, et al.
Published: (2025)

AutoFed: Personalized Federated Traffic Prediction via Adaptive Prompt
by: Zhao, Zijian, et al.
Published: (2025)

Ratio-Variance Regularized Policy Optimization for Efficient LLM Fine-tuning
by: Luo, Yu, et al.
Published: (2026)

Problem-oriented AutoML in Clustering
by: da Silva, Matheus Camilo, et al.
Published: (2024)

Auto-FP: An Experimental Study of Automated Feature Preprocessing for Tabular Data
by: Qi, Danrui, et al.
Published: (2023)

ExChanGeAI: An End-to-End Platform and Efficient Foundation Model for Electrocardiogram Analysis and Fine-tuning
by: Bickmann, Lucas, et al.
Published: (2025)

AutoGL: A Library for Automated Graph Learning
by: Zhang, Ziwei, et al.
Published: (2021)