Image de couverture de livre

On Penalty-based Bilevel Gradient Descent Method

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Shen, Han, Xiao, Quan, Chen, Tianyi
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF
par: Shen, Han, et autres
Publié: (2024)

Efficient Penalty-Based Bilevel Methods: Improved Analysis, Novel Updates, and Flatness Condition
par: Jiang, Liuyuan, et autres
Publié: (2025)

A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints
par: Jiang, Liuyuan, et autres
Publié: (2024)

Unlocking Global Optimality in Bilevel Optimization: A Pilot Study
par: Xiao, Quan, et autres
Publié: (2024)

Penalty-Based First-Order Methods for Bilevel Optimization with Minimax and Constrained Lower-Level Problems
par: Shen, Yiyang, et autres
Publié: (2026)

On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
par: Kwon, Jeongyeol, et autres
Publié: (2023)

Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
par: Chen, Lesi, et autres
Publié: (2025)

A First-order Generative Bilevel Optimization Framework for Diffusion Models
par: Xiao, Quan, et autres
Publié: (2025)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
par: Lin, Tianyi, et autres
Publié: (2019)

An Accelerated Gradient Method for Convex Smooth Simple Bilevel Optimization
par: Cao, Jincheng, et autres
Publié: (2024)

Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
par: Lin, Tianyi, et autres
Publié: (2024)

More Optimal Fractional-Order Stochastic Gradient Descent for Non-Convex Optimization Problems
par: Partohaghighi, Mohammad, et autres
Publié: (2025)

Effective Dimension Aware Fractional-Order Stochastic Gradient Descent for Convex Optimization Problems
par: Partohaghighi, Mohammad, et autres
Publié: (2025)

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
par: Zhang, Jiawei, et autres
Publié: (2020)

Accelerated Gradient Methods for Sparse Statistical Learning with Nonconvex Penalties
par: Yang, Kai, et autres
Publié: (2020)

Bilevel Learning with Inexact Stochastic Gradients
par: Salehi, Mohammad Sadegh, et autres
Publié: (2024)

A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming
par: Nazari, Parvin, et autres
Publié: (2022)

Safe Gradient Flow for Bilevel Optimization
par: Sharifi, Sina, et autres
Publié: (2025)

Unraveling the Gradient Descent Dynamics of Transformers
par: Song, Bingqing, et autres
Publié: (2024)

Anytime Acceleration of Gradient Descent
par: Zhang, Zihan, et autres
Publié: (2024)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods
par: Tarzanagh, Davoud Ataee, et autres
Publié: (2022)

Corner Gradient Descent
par: Yarotsky, Dmitry
Publié: (2025)

On the Convergence Theory of Pipeline Gradient-based Analog In-memory Training
par: Wu, Zhaoxian, et autres
Publié: (2024)

Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients
par: Chiang, John
Publié: (2022)

Parameter-free Clipped Gradient Descent Meets Polyak
par: Takezawa, Yuki, et autres
Publié: (2024)

Adaptive Conditional Gradient Descent
par: Khademi, Abbas, et autres
Publié: (2025)

$k$-SVD with Gradient Descent
par: Jedra, Yassir, et autres
Publié: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
par: Li, Tianyou, et autres
Publié: (2023)

A Unified Understanding of Offline Data Selection and Online Self-refining Generation for Post-training LLMs
par: Xiao, Quan, et autres
Publié: (2025)

DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method
par: Khaled, Ahmed, et autres
Publié: (2023)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
par: Lu, Eric
Publié: (2025)

A Bilevel Optimization Method for Inverse Mean-Field Games
par: Yu, Jiajia, et autres
Publié: (2024)

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
par: Fernando, Heshan, et autres
Publié: (2022)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
par: Li, Xiang, et autres
Publié: (2024)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent
par: Liu, Zhiyu, et autres
Publié: (2024)

First-ish Order Methods: Hessian-aware Scalings of Gradient Descent
par: Smee, Oscar, et autres
Publié: (2025)

The Method of Infinite Descent
par: Batley, Reza T., et autres
Publié: (2025)