Image de couverture de livre

On the Convergence of Single-Loop Stochastic Bilevel Optimization with Approximate Implicit Differentiation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhou, Yubo, Luo, Luo, Dai, Guang, Ye, Haishan
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization
par: Chen, Lesi, et autres
Publié: (2022)

Stochastic Bilevel Optimization with Heavy-Tailed Noise
par: Liu, Zhuanghua, et autres
Publié: (2025)

Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity
par: Zhou, Qihao, et autres
Publié: (2024)

A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
par: Gong, Xiaochuan, et autres
Publié: (2024)

Explicit and Non-asymptotic Query Complexities of Rank-Based Zeroth-order Algorithm on Stochastic Smooth Functions
par: Ye, Haishan
Publié: (2025)

Optimal High-Probability Regret for Online Convex Optimization with Two-Point Bandit Feedback
par: Ye, Haishan
Publié: (2026)

Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
par: Grazzi, Riccardo, et autres
Publié: (2024)

A Provably Convergent Plug-and-Play Framework for Stochastic Bilevel Optimization
par: Chu, Tianshu, et autres
Publié: (2025)

On the Complexity of Decentralized Smooth Nonconvex Finite-Sum Optimization
par: Luo, Luo, et autres
Publié: (2022)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
par: Dong, Youran, et autres
Publié: (2023)

On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
par: Kwon, Jeongyeol, et autres
Publié: (2023)

Understanding the Generalization of Bilevel Programming in Hyperparameter Optimization: A Tale of Bias-Variance Decomposition
par: Zhou, Yubo, et autres
Publié: (2026)

ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning
par: Sun, Zhishen, et autres
Publié: (2026)

SPABA: A Single-Loop and Probabilistic Stochastic Bilevel Algorithm Achieving Optimal Sample Complexity
par: Chu, Tianshu, et autres
Publié: (2024)

Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
par: Zhao, Yanjun, et autres
Publié: (2024)

SPARKLE: A Unified Single-Loop Primal-Dual Framework for Decentralized Bilevel Optimization
par: Zhu, Shuchen, et autres
Publié: (2024)

A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization
par: Shen, Wei, et autres
Publié: (2025)

An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization
par: Ye, Haishan, et autres
Publié: (2025)

Differentially Private Bilevel Optimization
par: Kornowski, Guy
Publié: (2024)

Tuning-Free Bilevel Optimization: New Algorithms and Convergence Analysis
par: Yang, Yifan, et autres
Publié: (2024)

Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
par: Di, Hao, et autres
Publié: (2024)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
par: Yin, Chao, et autres
Publié: (2026)

Explicit and Non-asymptotic Query Complexities of Rank-Based Zeroth-order Algorithms on Smooth Functions
par: Ye, Haishan
Publié: (2025)

Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization
par: Dong, Youran, et autres
Publié: (2025)

FZOO: Fast Zeroth-Order Optimizer for Fine-Tuning Large Language Models towards Adam-Scale Speed
par: Dang, Sizhe, et autres
Publié: (2025)

On the Complexity of First-Order Methods in Stochastic Bilevel Optimization
par: Kwon, Jeongyeol, et autres
Publié: (2024)

Towards Understanding The Calibration Benefits of Sharpness-Aware Minimization
par: Tan, Chengli, et autres
Publié: (2025)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)

Near-Optimal Algorithms for Making the Gradient Small in Stochastic Minimax Optimization
par: Chen, Lesi, et autres
Publié: (2022)

On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
par: Gong, Xiaochuan, et autres
Publié: (2025)

Fine-grained Analysis of Stability and Generalization for Stochastic Bilevel Optimization
par: Zhang, Xuelin, et autres
Publié: (2026)

Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
par: Chen, Lesi, et autres
Publié: (2025)

An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
par: Gong, Xiaochuan, et autres
Publié: (2024)

From $O(mn)$ to $O(r^2)$: Two-Sided Low-Rank Communication for Adam in Distributed Training with Memory Efficiency
par: Dang, Sizhe, et autres
Publié: (2026)

BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
par: Zhang, Hengrui, et autres
Publié: (2026)

Implicit Neural Differential Model for Spatiotemporal Dynamics
par: Akhare, Deepak, et autres
Publié: (2025)

Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis
par: Hao, Jie, et autres
Publié: (2024)

Single-Loop Deterministic and Stochastic Interior-Point Algorithms for Nonlinearly Constrained Optimization
par: Curtis, Frank E., et autres
Publié: (2024)

Bilevel Learning with Inexact Stochastic Gradients
par: Salehi, Mohammad Sadegh, et autres
Publié: (2024)

Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
par: Wu, Yidong, et autres
Publié: (2026)