Cover Image

Anderson-type acceleration method for Deep Neural Network optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ito, Kazufumi, Xue, Tiancheng
Format:	Preprint
Published:	2025
Subjects:	Numerical Analysis Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reduced order method based Anderson-type acceleration method for nonlinear least square problems and large scale ill-posed problems
by: Ito, Kazufumi, et al.
Published: (2025)

An accelerated gradient method with adaptive restart for convex multiobjective optimization problems
by: Luo, Hao, et al.
Published: (2025)

Gauss-Southwell type descent methods for low-rank matrix optimization
by: Olikier, Guillaume, et al.
Published: (2023)

An augmented Lagrangian trust-region method with inexact gradient evaluations to accelerate constrained optimization problems using model hyperreduction
by: Wen, Tianshu, et al.
Published: (2024)

Limited memory gradient methods for unconstrained optimization
by: Ferrandi, Giulia, et al.
Published: (2023)

An acceleration technique for methods for finding the nearest point in a polytope and computing the distance between two polytopes
by: Dolgopolik, M. V.
Published: (2022)

Particle method for a nonlinear multimarginal optimal transport problem
by: Cances, Adrien, et al.
Published: (2026)

IETI-based Low-Rank method for PDE-constrained optimization
by: Bünger, Alexandra, et al.
Published: (2024)

An efficient algorithm for entropic optimal transport under martingale-type constraints
by: Tang, Xun, et al.
Published: (2025)

GPU-accelerated FREDopt package for simultaneous dose and LETd proton radiotherapy plan optimization via superiorization methods
by: Borys, Damian, et al.
Published: (2025)

A robust and stable phase field method for structural topology optimization
by: Chen, Huangxin, et al.
Published: (2025)

Optimal local linear convergence of Nesterov's accelerated gradient method for $C^2$ functions under the Polyak--Łojasiewicz inequality
by: Feng, Zixu, et al.
Published: (2026)

On a fixed-point continuation method for a convex optimization problem
by: Fest, Jean-Baptiste, et al.
Published: (2022)

Non-overlapping Schwarz methods in time for parabolic optimal control problems
by: Gander, Martin Jakob, et al.
Published: (2024)

Regularized methods via cubic model subspace minimization for nonconvex optimization
by: Bellavia, Stefania, et al.
Published: (2023)

The Dynamical Anatomy of Anderson Acceleration:From Adaptive Momentum to Variable-Mass ODEs
by: Chen, Kewang, et al.
Published: (2025)

Weak Scalability of time parallel Schwarz methods for parabolic optimal control problems
by: Lu, Liu-Di, et al.
Published: (2026)

Augmented Lagrangian methods for infeasible convex optimization problems and diverging proximal-point algorithms
by: Andrews, Roland, et al.
Published: (2025)

Bioluminescence tomography via a shape optimization method based on a complex-valued model
by: Wu, Qianqian, et al.
Published: (2025)

Error estimates of $hp$-finite element method for elliptic optimal control problems with robin boundary
by: Lin, Xingyuan, et al.
Published: (2026)

An unfitted finite element method for PDE-constrained shape optimization via shape gradient flow
by: Gong, Wei, et al.
Published: (2026)

Numerical method for approximately optimal solutions of two-stage distributionally robust optimization with marginal constraints
by: Neufeld, Ariel, et al.
Published: (2022)

A Primal-dual hybrid gradient method for solving optimal control problems and the corresponding Hamilton-Jacobi PDEs
by: Meng, Tingwei, et al.
Published: (2024)

Numerical method for feasible and approximately optimal solutions of multi-marginal optimal transport beyond discrete measures
by: Neufeld, Ariel, et al.
Published: (2022)

Averaged Adam accelerates stochastic optimization in the training of deep neural network approximations for partial differential equation and optimal control problems
by: Dereich, Steffen, et al.
Published: (2025)

Derivative-free optimization is competitive for aerodynamic design optimization in moderate dimensions
by: Plaban, Punya, et al.
Published: (2025)

Automatic discovery of optimal meta-solvers via multi-objective optimization
by: Lee, Youngkyu, et al.
Published: (2024)

Spiking Neural Networks: a theoretical framework for Universal Approximation and training
by: Biccari, Umberto
Published: (2025)

On the optimization of discrepancy measures
by: Clément, François, et al.
Published: (2025)

A Unified Phase-Field Fourier Neural Network Framework for Topology Optimization
by: Li, Jing, et al.
Published: (2025)

Numerical Analysis on Neural Network Projected Schemes for Approximating One Dimensional Wasserstein Gradient Flows
by: Zuo, Xinzhe, et al.
Published: (2024)

The bilinear Hessian for large scale optimization
by: Carlsson, Marcus, et al.
Published: (2025)

Variable aggregation for nonlinear optimization problems
by: Naik, Sakshi, et al.
Published: (2025)

Unidimensional semi-discrete partial optimal transport
by: Cances, Adrien, et al.
Published: (2025)

Reliable optimal controls for SEIR models in epidemiology
by: Cacace, Simone, et al.
Published: (2023)

Contractivity of neural ODEs: an eigenvalue optimization problem
by: Guglielmi, Nicola, et al.
Published: (2024)

Kinetic based optimization enhanced by genetic dynamics
by: Albi, Giacomo, et al.
Published: (2023)

Shape optimization of harmonic helicity in toroidal domains
by: Robin, Remi, et al.
Published: (2024)

Introduction to optimization methods for training SciML models
by: Kopaničáková, Alena, et al.
Published: (2026)

A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations
by: Zhang, Guangtao, et al.
Published: (2024)