Fast Computational Methods for Regularized Estimating Equations

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Shi, Weihua, Li, Yixuan, Lian, Yi, Yang, Archer Y., Zhao, Yue
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916046836858880
author Shi, Weihua
Li, Yixuan
Lian, Yi
Yang, Archer Y.
Zhao, Yue
author_facet Shi, Weihua
Li, Yixuan
Lian, Yi
Yang, Archer Y.
Zhao, Yue
contents Estimating equations arise in a wide range of statistical applications, including longitudinal and clustered data analysis, survival analysis, econometrics, and semiparametric inference. In high-dimensional settings, adding sparsity-inducing regularization often leads to computational challenges that are not fully addressed by standard penalized optimization routines. These challenges are closely tied to the structural form of the underlying estimating problem: mainly, the estimating function needs not be the gradient of a scalar objective and may involve asymmetric Jacobians, overidentification, nonsmoothness, nonconvexity, or nested optimization. This article first reviews the application areas of estimating equations, and then the computational methods for regularized estimating equations by organizing them into four broad formulations: minimization-type, Dantzig-type, regularization-type, and fixed-point-type approaches. We discuss the main numerical strategies associated with each formulation, including penalized optimization, constrained linear programming, iterative root-solving, and proximal fixed-point iteration. We also highlight the connection between regularized estimating equations and fixed-point problems, which provides a unified computational perspective for analyzing and solving regularized estimating equations.
format Preprint
id arxiv_https___arxiv_org_abs_2605_26422
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Fast Computational Methods for Regularized Estimating Equations
Shi, Weihua
Li, Yixuan
Lian, Yi
Yang, Archer Y.
Zhao, Yue
Computation
Estimating equations arise in a wide range of statistical applications, including longitudinal and clustered data analysis, survival analysis, econometrics, and semiparametric inference. In high-dimensional settings, adding sparsity-inducing regularization often leads to computational challenges that are not fully addressed by standard penalized optimization routines. These challenges are closely tied to the structural form of the underlying estimating problem: mainly, the estimating function needs not be the gradient of a scalar objective and may involve asymmetric Jacobians, overidentification, nonsmoothness, nonconvexity, or nested optimization. This article first reviews the application areas of estimating equations, and then the computational methods for regularized estimating equations by organizing them into four broad formulations: minimization-type, Dantzig-type, regularization-type, and fixed-point-type approaches. We discuss the main numerical strategies associated with each formulation, including penalized optimization, constrained linear programming, iterative root-solving, and proximal fixed-point iteration. We also highlight the connection between regularized estimating equations and fixed-point problems, which provides a unified computational perspective for analyzing and solving regularized estimating equations.
title Fast Computational Methods for Regularized Estimating Equations
topic Computation
url https://arxiv.org/abs/2605.26422