Imagen de Portada

Tuning-Free Bilevel Optimization: New Algorithms and Convergence Analysis

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yang, Yifan, Ban, Hao, Huang, Minhui, Ma, Shiqian, Ji, Kaiyi
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Achieving ${O}(ε^{-1.5})$ Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization
por: Yang, Yifan, et al.
Publicado: (2023)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
por: Ban, Hao, et al.
Publicado: (2025)

Lower Complexity Bounds for Nonconvex-Strongly-Convex Bilevel Optimization with First-Order Oracles
por: Ji, Kaiyi
Publicado: (2025)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
por: Dong, Youran, et al.
Publicado: (2023)

Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis
por: Hao, Jie, et al.
Publicado: (2024)

Fair Resource Allocation in Multi-Task Learning
por: Ban, Hao, et al.
Publicado: (2024)

SAMO: A Lightweight Sharpness-Aware Approach for Multi-Task Optimization with Joint Global-Local Perturbation
por: Ban, Hao, et al.
Publicado: (2025)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
por: Yin, Chao, et al.
Publicado: (2026)

A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization
por: Shen, Wei, et al.
Publicado: (2025)

On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
por: Gong, Xiaochuan, et al.
Publicado: (2025)

Fully First-Order Methods for Decentralized Bilevel Optimization
por: Wang, Xiaoyu, et al.
Publicado: (2024)

New Hybrid Fine-Tuning Paradigm for LLMs: Algorithm Design and Convergence Analysis Framework
por: Ma, Shaocong, et al.
Publicado: (2026)

Theoretical Study of Conflict-Avoidant Multi-Objective Reinforcement Learning
por: Wang, Yudan, et al.
Publicado: (2024)

Hyperparameter Tuning Through Pessimistic Bilevel Optimization
por: Ustun, Meltem Apaydin, et al.
Publicado: (2024)

On the Convergence Analysis of Muon
por: Shen, Wei, et al.
Publicado: (2025)

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization
por: Huang, Feihu
Publicado: (2024)

An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
por: Gong, Xiaochuan, et al.
Publicado: (2024)

Bilevel Optimization with Lower-Level Uniform Convexity: Theory and Algorithm
por: Wu, Yuman, et al.
Publicado: (2026)

On the Convergence of Single-Loop Stochastic Bilevel Optimization with Approximate Implicit Differentiation
por: Zhou, Yubo, et al.
Publicado: (2026)

MGDA Converges under Generalized Smoothness, Provably
por: Zhang, Qi, et al.
Publicado: (2024)

Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling
por: Li, Junyi, et al.
Publicado: (2024)

A New Inexact Proximal Linear Algorithm with Adaptive Stopping Criteria for Robust Phase Retrieval
por: Zheng, Zhong, et al.
Publicado: (2023)

Problem-Parameter-Free Decentralized Bilevel Optimization
por: Zhai, Zhiwei, et al.
Publicado: (2025)

Escaping Saddle Points for Nonsmooth Weakly Convex Functions via Perturbed Proximal Algorithms
por: Huang, Minhui, et al.
Publicado: (2021)

A Provably Convergent Plug-and-Play Framework for Stochastic Bilevel Optimization
por: Chu, Tianshu, et al.
Publicado: (2025)

Riemannian Dueling Optimization
por: Ren, Yuxuan, et al.
Publicado: (2026)

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
por: Shirkavand, Reza, et al.
Publicado: (2025)

Fully First-Order Algorithms for Online Bilevel Optimization
por: Jia, Tingkai, et al.
Publicado: (2026)

A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
por: Gong, Xiaochuan, et al.
Publicado: (2024)

Riemannian Bilevel Optimization
por: Li, Jiaxiang, et al.
Publicado: (2024)

The Convergence Gap: Instruction-Tuned Language Models Stabilize Later in the Forward Pass
por: Zhou, Yifan
Publicado: (2026)

Turning Back Without Forgetting: Selective Backward Refinement for Parameter-Efficient Continual Learning
por: Tiwari, Anushka, et al.
Publicado: (2026)

Functional Bilevel Optimization for Machine Learning
por: Petrulionyte, Ieva, et al.
Publicado: (2024)

Non-Stationary Functional Bilevel Optimization
por: Bohne, Jason, et al.
Publicado: (2026)

Learning Theory for Kernel Bilevel Optimization
por: Khoury, Fares El, et al.
Publicado: (2025)

Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
por: Gong, Xiaochuan, et al.
Publicado: (2025)

Information-Theoretic Bayesian Optimization for Bilevel Optimization Problems
por: Kanayama, Takuya, et al.
Publicado: (2025)

Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications
por: Huang, Yue, et al.
Publicado: (2024)

Fine-grained Analysis of Stability and Generalization for Stochastic Bilevel Optimization
por: Zhang, Xuelin, et al.
Publicado: (2026)

Bayesian Optimization of Bilevel Problems
por: Ekmekcioglu, Omer, et al.
Publicado: (2024)