Cover Image

Comparing the Moore-Penrose Pseudoinverse and Gradient Descent for Solving Linear Regression Problems: A Performance Analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Adams, Alex
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Differentiable SVD based on Moore-Penrose Pseudoinverse for Inverse Imaging Problems
by: Zhang, Yinghao, et al.
Published: (2024)

The Moore-Penrose Pseudoinverse: A Tutorial Review of the Theory
by: João Carlos Alves Barata
Published: (2012)

Trained Mamba Emulates Online Gradient Descent in In-Context Linear Regression
by: Jiang, Jiarui, et al.
Published: (2025)

Scaling Law for Stochastic Gradient Descent in Quadratically Parameterized Linear Regression
by: Ding, Shihong, et al.
Published: (2025)

Robustness of Iteratively Pre-Conditioned Gradient-Descent Method: The Case of Distributed Linear Regression Problem
by: Chakrabarti, Kushal, et al.
Published: (2021)

Turing meets Moore-Penrose: Computing the Pseudoinverse on Turing Machines
by: Boche, Holger, et al.
Published: (2022)

Solving Inverse Problems with Deep Linear Neural Networks: Global Convergence Guarantees for Gradient Descent with Weight Decay
by: Laus, Hannah, et al.
Published: (2025)

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
by: Zhang, Chenyang, et al.
Published: (2026)

Stochastic Gradient Descent for Nonparametric Additive Regression
by: Chen, Xin, et al.
Published: (2024)

Modifying the Time-Convolutionless Master Equation via the Moore-Penrose Pseudoinverse
by: Blumenfeld, Caleb
Published: (2025)

Iterative Methods for Computing the Moore-Penrose Pseudoinverse of Quaternion Matrices, with Applications
by: Leplat, Valentin, et al.
Published: (2025)

Characterization of Matrices Satisfying the Reverse Order Law for the Moore-Penrose Pseudoinverse
by: Kędzierski, Oskar
Published: (2024)

Learning Curves of Stochastic Gradient Descent in Kernel Regression
by: Zhang, Haihan, et al.
Published: (2025)

Robust Gradient Descent for Phase Retrieval
by: Buna, Alex, et al.
Published: (2024)

Physics-informed Gaussian Process Regression in Solving Eigenvalue Problem of Linear Operators
by: Bai, Tianming, et al.
Published: (2026)

Private Gradient Descent for Linear Regression: Tighter Error Bounds and Instance-Specific Uncertainty Estimation
by: Brown, Gavin, et al.
Published: (2024)

Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)

Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)

Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Models
by: Zheng, Yang, et al.
Published: (2025)

A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models
by: Xu, Ziqing, et al.
Published: (2025)

Semi-adaptive Synergetic Two-way Pseudoinverse Learning System
by: Liu, Binghong, et al.
Published: (2024)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
by: Kale, Sacchit, et al.
Published: (2026)

Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension
by: Crawshaw, Michael, et al.
Published: (2026)

Complex Equation Learner: Rational Symbolic Regression with Gradient Descent in Complex Domain
by: Garmaev, Sergei, et al.
Published: (2026)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
by: Beneventano, Pierfrancesco, et al.
Published: (2025)

Stochastic Gradient Descent in the Saddle-to-Saddle Regime of Deep Linear Networks
by: Corlouer, Guillaume, et al.
Published: (2026)

Gradient Descent with Linearly Correlated Noise: Theory and Applications to Differential Privacy
by: Koloskova, Anastasia, et al.
Published: (2023)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
by: Lin, Tianyi, et al.
Published: (2019)

Open Problem: Anytime Convergence Rate of Gradient Descent
by: Kornowski, Guy, et al.
Published: (2024)

Sparse Linear Regression and Lattice Problems
by: Gupte, Aparna, et al.
Published: (2024)

Iterative Pre-Conditioning for Expediting the Gradient-Descent Method: The Distributed Linear Least-Squares Problem
by: Chakrabarti, Kushal, et al.
Published: (2020)

Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes
by: Zhang, Ruiqi, et al.
Published: (2025)

From Logistic Regression to the Perceptron Algorithm: Exploring Gradient Descent with Large Step Sizes
by: Tyurin, Alexander
Published: (2024)

Trustworthy Image Super-Resolution via Generative Pseudoinverse
by: Floros, Andreas, et al.
Published: (2025)

Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law
by: Kunstner, Frederik, et al.
Published: (2025)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
by: Jung, Hyunji, et al.
Published: (2025)

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
by: Wang, Mingze, et al.
Published: (2023)

Continuum Transformers Perform In-Context Learning by Operator Gradient Descent
by: Mishra, Abhiti, et al.
Published: (2025)

Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context
by: Cheng, Xiang, et al.
Published: (2023)

Occam Gradient Descent
by: Kausik, B. N.
Published: (2024)