Cover Image

Understanding the Generalization of Bilevel Programming in Hyperparameter Optimization: A Tale of Bias-Variance Decomposition

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Yubo, Shu, Jun, Liu, Junmin, Meng, Deyu
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hyperparameter Tuning Through Pessimistic Bilevel Optimization
by: Ustun, Meltem Apaydin, et al.
Published: (2024)

A Generalized Bias-Variance Decomposition for Bregman Divergences
by: Pfau, David
Published: (2025)

A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Models
by: Gruber, Sebastian G., et al.
Published: (2023)

On the Convergence of Single-Loop Stochastic Bilevel Optimization with Approximate Implicit Differentiation
by: Zhou, Yubo, et al.
Published: (2026)

A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws
by: Shu, Jun, et al.
Published: (2026)

KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra
by: Su, Liangyu, et al.
Published: (2026)

A Bias-Variance Decomposition for Ensembles over Multiple Synthetic Datasets
by: Räisä, Ossi, et al.
Published: (2024)

A Tale of Two Problems: Multi-Task Bilevel Learning Meets Equality Constrained Multi-Objective Optimization
by: Zhang, Zhiyao, et al.
Published: (2026)

On the Emergence of Weak-to-Strong Generalization: A Bias-Variance Perspective
by: Xu, Gengze, et al.
Published: (2025)

Rethinking Semi-Supervised Imbalanced Node Classification from Bias-Variance Decomposition
by: Yan, Liang, et al.
Published: (2023)

Improving Memory Efficiency for Training KANs via Meta Learning
by: Zhao, Zhangchi, et al.
Published: (2025)

FairTree: Subgroup Fairness Auditing of Machine Learning Models with Bias-Variance Decomposition
by: Debelak, Rudolf
Published: (2026)

Beyond Explained Variance: A Cautionary Tale of PCA
by: Marchetti, Gionni
Published: (2026)

Long N-step Surrogate Stage Reward to Reduce Variances of Deep Reinforcement Learning in Complex Problems
by: Zhong, Junmin, et al.
Published: (2022)

Learning Non-Vacuous Generalization Bounds from Optimization
by: Tan, Chengli, et al.
Published: (2022)

Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective
by: Wang, Quanziang, et al.
Published: (2024)

A Tale of Two Variances: When Single-Seed Benchmarks Fail in Bayesian Deep Learning
by: Zhan, Qishi, et al.
Published: (2026)

Overtuning in Hyperparameter Optimization
by: Schneider, Lennart, et al.
Published: (2025)

The Bias-Variance Tradeoff in Data-Driven Optimization: A Local Misspecification Perspective
by: Lan, Haixiang, et al.
Published: (2025)

Stochastic Bilevel Optimization with Heavy-Tailed Noise
by: Liu, Zhuanghua, et al.
Published: (2025)

Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis
by: Li, Yufan, et al.
Published: (2024)

Problem-Parameter-Free Decentralized Bilevel Optimization
by: Zhai, Zhiwei, et al.
Published: (2025)

Hyperparameter Optimization in Machine Learning
by: Franceschi, Luca, et al.
Published: (2024)

Reshuffling Resampling Splits Can Improve Generalization of Hyperparameter Optimization
by: Nagler, Thomas, et al.
Published: (2024)

Online Continuous Hyperparameter Optimization for Generalized Linear Contextual Bandits
by: Kang, Yue, et al.
Published: (2023)

A First-order Generative Bilevel Optimization Framework for Diffusion Models
by: Xiao, Quan, et al.
Published: (2025)

Towards Understanding The Calibration Benefits of Sharpness-Aware Minimization
by: Tan, Chengli, et al.
Published: (2025)

Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
by: Fehring, Lukas, et al.
Published: (2025)

An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming
by: Xu, Minkai, et al.
Published: (2021)

Understanding the Mechanisms of Fast Hyperparameter Transfer
by: Ghosh, Nikhil, et al.
Published: (2025)

Fine-Grained Dynamic Framework for Bias-Variance Joint Optimization on Data Missing Not at Random
by: Ha, Mingming, et al.
Published: (2024)

On the Stability and Generalization of First-order Bilevel Minimax Optimization
by: Zhang, Xuelin, et al.
Published: (2026)

Non-Stationary Functional Bilevel Optimization
by: Bohne, Jason, et al.
Published: (2026)

Functional Bilevel Optimization for Machine Learning
by: Petrulionyte, Ieva, et al.
Published: (2024)

Learning Theory for Kernel Bilevel Optimization
by: Khoury, Fares El, et al.
Published: (2025)

Quantum-Inspired Analysis of Neural Network Vulnerabilities: The Role of Conjugate Variables in System Attacks
by: Zhang, Jun-Jie, et al.
Published: (2024)

Decoding Decoded: Understanding Hyperparameter Effects in Open-Ended Text Generation
by: Arias, Esteban Garces, et al.
Published: (2024)

Exact Finite-Sample Variance Decomposition of Subagging: A Spectral Filtering Perspective
by: Su, Ye, et al.
Published: (2026)

Gradient Descent, Stochastic Optimization, and Other Tales
by: Lu, Jun
Published: (2022)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
by: Rakotoarison, Herilalaina, et al.
Published: (2024)