Image de couverture de livre

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fernando, Heshan, Shen, Han, Liu, Miao, Chaudhury, Subhajit, Murugesan, Keerthiram, Chen, Tianyi
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Learning Provably Improves the Convergence of Gradient Descent
par: Song, Qingyu, et autres
Publié: (2025)

Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees
par: Deng, Yuyang, et autres
Publié: (2024)

Understanding Forgetting in LLM Supervised Fine-Tuning and Preference Learning -- A Convex Optimization Perspective
par: Fernando, Heshan, et autres
Publié: (2024)

Convergence of the Iterates of the Stochastic Proximal Gradient Method
par: Madariaga, Javier I.
Publié: (2026)

On Penalty-based Bilevel Gradient Descent Method
par: Shen, Han, et autres
Publié: (2023)

Improved Convergence for Decentralized Stochastic Optimization with Biased Gradients
par: Xu, Qing, et autres
Publié: (2026)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
par: Li, Tianyou, et autres
Publié: (2023)

Provably Convergent Federated Trilevel Learning
par: Jiao, Yang, et autres
Publié: (2023)

Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods
par: Liu, Zijian, et autres
Publié: (2023)

A Provably Convergent Plug-and-Play Framework for Stochastic Bilevel Optimization
par: Chu, Tianshu, et autres
Publié: (2025)

Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
par: Xiao, Minheng, et autres
Publié: (2024)

A Convex Optimization Approach to Model-Free Inverse Optimal Control with Provable Convergence
par: Yu, Meiling, et autres
Publié: (2025)

Convergence Analysis of Stochastic Accelerated Gradient Methods for Generalized Smooth Optimizations
par: Yu, Chenhao, et autres
Publié: (2025)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
par: Liu, Zijian
Publié: (2026)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)

Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization
par: Han, Dongyu, et autres
Publié: (2024)

Almost Sure Convergence Analysis of Differentially Private Stochastic Gradient Methods
par: Mukherjee, Amartya, et autres
Publié: (2025)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
par: Vaswani, Sharan, et autres
Publié: (2025)

On the Convergence and Complexity of the Stochastic Central Finite-Difference Based Gradient Estimation Methods
par: Bollapragada, Raghu, et autres
Publié: (2025)

Convergence of Policy Gradient for Stochastic Linear-Quadratic Control Problem in Infinite Horizon
par: Zhang, Xinpei, et autres
Publié: (2024)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
par: Jung, Hyunji, et autres
Publié: (2025)

High Probability Convergence of Distributed Clipped Stochastic Gradient Descent with Heavy-tailed Noise
par: Yang, Yuchen, et autres
Publié: (2025)

The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
par: Feng, Yasong, et autres
Publié: (2023)

On Linear Convergence of Distributed Stochastic Bilevel Optimization over Undirected Networks via Gradient Aggregation
par: Tak, Ajay, et autres
Publié: (2025)

Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Multi-objective Optimization
par: Huang, Chengzhi
Publié: (2023)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
par: Pan, Rui, et autres
Publié: (2023)

High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise
par: Madden, Liam, et autres
Publié: (2020)

On the Convergence of Decentralized Stochastic Gradient-Tracking with Finite-Time Consensus
par: Fainman, Aaron, et autres
Publié: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
par: Kale, Sacchit, et autres
Publié: (2026)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
par: Mishkin, Aaron, et autres
Publié: (2024)

Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime
par: Oberweis, Noah, et autres
Publié: (2025)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
par: Kong, Boao, et autres
Publié: (2026)

Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF
par: Shen, Han, et autres
Publié: (2024)

A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems
par: Wang, Qingsong, et autres
Publié: (2024)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
par: Liu, Zijian, et autres
Publié: (2024)

MGDA Converges under Generalized Smoothness, Provably
par: Zhang, Qi, et autres
Publié: (2024)

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
par: Oowada, Kanata, et autres
Publié: (2025)

Beyond Stationarity: Convergence Analysis of Stochastic Softmax Policy Gradient Methods
par: Klein, Sara, et autres
Publié: (2023)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
par: Li, Xiang, et autres
Publié: (2024)

Model-Targeted Data Poisoning Attacks against ITS Applications with Provable Convergence
par: Wang, Xin, et autres
Publié: (2025)