Cover Image

Near-Optimal Tensor PCA via Normalized Stochastic Gradient Ascent with Overparameterization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ding, Shihong, Gu, Yihong, Liu, Yuanshi, Fang, Cong
Format:	Preprint
Published:	2025
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization
by: Zhang, Haihan, et al.
Published: (2024)

Near-optimal and Efficient First-Order Algorithm for Multi-Task Learning with Shared Linear Representation
by: Ding, Shihong, et al.
Published: (2026)

Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
by: Shen, Wei, et al.
Published: (2023)

Accelerating Single-Pass SGD for Generalized Linear Prediction
by: Chen, Qian, et al.
Published: (2026)

Optimizing over Multiple Distributions under Generalized Quasar-Convexity Condition
by: Ding, Shihong, et al.
Published: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
by: Gao, Hongchang
Published: (2022)

Sobolev Gradient Ascent for Optimal Transport: Barycenter Optimization and Convergence Analysis
by: Kim, Kaheon, et al.
Published: (2025)

The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing
by: Xu, Yang, et al.
Published: (2024)

Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification
by: Zhang, Gavin, et al.
Published: (2022)

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization
by: Zhu, Yuchen, et al.
Published: (2024)

On the Benefits of Weight Normalization for Overparameterized Matrix Sensing
by: Wei, Yudong, et al.
Published: (2025)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
by: Lin, Tianyi, et al.
Published: (2019)

Dual Block Gradient Ascent for Entropically Regularised Quantum Optimal Transport
by: Randig, Marvin, et al.
Published: (2025)

Multi-step Inertial Accelerated Doubly Stochastic Gradient Methods for Block Term Tensor Decomposition
by: Liu, Zehui, et al.
Published: (2025)

Near-Optimal Performance of Stochastic Model Predictive Control
by: Shin, Sungho, et al.
Published: (2022)

An Improved Last-Iterate Convergence Rate for Anchored Gradient Descent Ascent
by: Surina, Anja, et al.
Published: (2026)

Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
by: Lin, Tianyi, et al.
Published: (2024)

Distributed Normal Map-based Stochastic Proximal Gradient Methods over Networks
by: Huang, Kun, et al.
Published: (2024)

Non-Asymptotic Optimization and Generalization Bounds for Stochastic Gauss-Newton in Overparameterized Models
by: Cayci, Semih
Published: (2025)

Boosting Gradient Ascent for Continuous DR-submodular Maximization
by: Zhang, Qixin, et al.
Published: (2024)

The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing
by: Xu, Xingyu, et al.
Published: (2023)

One-Point Residual Feedback Algorithms for Distributed Online Convex and Non-convex Optimization
by: Wang, Yaowen, et al.
Published: (2025)

Negative Stepsizes Make Gradient-Descent-Ascent Converge
by: Shugart, Henry, et al.
Published: (2025)

AGDA+: Proximal Alternating Gradient Descent Ascent Method with a Nonmonotone Adaptive Step-Size Search for Nonconvex Minimax Problems
by: Zhang, Xuan, et al.
Published: (2024)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
by: Wang, Menglian, et al.
Published: (2026)

Adaptive Gradient Normalization and Independent Sampling for (Stochastic) Generalized-Smooth Optimization
by: Yang, Yufeng, et al.
Published: (2024)

Stabilizing Optimal Control for Nonlinear Stochastic Systems: A Parametric Gradient-Based Approach
by: Ito, Yuji, et al.
Published: (2025)

A Parameter-Free and Near-Optimal Zeroth-Order Algorithm for Stochastic Convex Optimization
by: Ren, Kunjie, et al.
Published: (2025)

On the (almost) Global Exponential Convergence of the Overparameterized Policy Optimization for the LQR Problem
by: Wafi, Moh Kamalul, et al.
Published: (2025)

Avoiding Bias in Clipped SGD for Overparameterized Models under Generalized Smoothness
by: Lobanov, Aleksandr, et al.
Published: (2026)

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
by: Zhang, Jiawei, et al.
Published: (2020)

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
by: Zheng, Tianqi, et al.
Published: (2024)

More is Less: Inducing Sparsity via Overparameterization
by: Chou, Hung-Hsu, et al.
Published: (2021)

Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization
by: Han, Dongyu, et al.
Published: (2024)

Prescriptive PCA: Dimensionality Reduction for Two-stage Stochastic Optimization
by: He, Long, et al.
Published: (2023)

Multiobjective Accelerated Gradient-like Flow with Asymptotic Vanishing Normalized Gradient
by: Yin, Yingdong
Published: (2025)

Stochastic Optimal Control via Local Occupation Measures
by: Holtorf, Flemming, et al.
Published: (2022)

A Scalable Bundle Method for Exact Reformulation of SDP in Three-Phase Power Flow Feasibility
by: Fang, Bohang, et al.
Published: (2026)

Model Consistency of the Iterative Regularization of Dual Ascent for Low-Complexity Regularization
by: Gao, Jie, et al.
Published: (2025)

Stochastic Auto-conditioned Fast Gradient Methods with Optimal Rates
by: Ji, Yao, et al.
Published: (2026)