Copertina

A Non-Monotone Preconditioned Trust-Region Method for Neural Network Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Angino, Andrea, Çapriqi, Bindi, Likaj, Shega, Trotti, Ken, Krause, Rolf
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Optimization and Control Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

An Additively Preconditioned Trust Region Strategy for Machine Learning
di: Alegría, Samuel Cruz, et al.
Pubblicazione: (2025)

Data-Parallel Neural Network Training via Nonlinearly Preconditioned Trust-Region Method
di: Alegría, Samuel A. Cruz, et al.
Pubblicazione: (2025)

Protect the Brain When Treating the Heart: A Convolutional Neural Network for Detecting Emboli
di: Angino, Andrea, et al.
Pubblicazione: (2026)

An Inexact Weighted Proximal Trust-Region Method
di: Maia, Leandro Farias, et al.
Pubblicazione: (2026)

Stochastic Gradient Methods with Preconditioned Updates
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2022)

Stochastic Trust-Region Methods for Over-parameterized Models
di: Yang, Aike, et al.
Pubblicazione: (2026)

TRSVR: An Adaptive Stochastic Trust-Region Method with Variance Reduction
di: Fang, Yuchen, et al.
Pubblicazione: (2026)

Bayesian Optimization with Preference Exploration using a Monotonic Neural Network Ensemble
di: Wang, Hanyang, et al.
Pubblicazione: (2025)

On The Concurrence of Layer-wise Preconditioning Methods and Provable Feature Learning
di: Zhang, Thomas T., et al.
Pubblicazione: (2025)

LAGO: A Local-Global Optimization Framework Combining Trust Region Methods and Bayesian Optimization
di: Van Dieren, Eliott, et al.
Pubblicazione: (2026)

PROMISE: Preconditioned Stochastic Optimization Methods by Incorporating Scalable Curvature Estimates
di: Frangella, Zachary, et al.
Pubblicazione: (2023)

Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization
di: Kovalev, Dmitry
Pubblicazione: (2025)

Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
di: Veprikov, Andrey, et al.
Pubblicazione: (2025)

Neighbor-Sampling Based Momentum Stochastic Methods for Training Graph Neural Networks
di: Noel, Molly, et al.
Pubblicazione: (2025)

A Trust-Region Algorithm for Noisy Equality Constrained Optimization
di: Sun, Shigeng, et al.
Pubblicazione: (2024)

Parameter-Free Non-Ergodic Extragradient Algorithms for Solving Monotone Variational Inequalities
di: Shen, Lingqing, et al.
Pubblicazione: (2026)

A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Method
di: Fang, Yuchen, et al.
Pubblicazione: (2026)

Trust-Region Methods with Low-Fidelity Objective Models
di: Angino, Andrea, et al.
Pubblicazione: (2025)

Mirror and Preconditioned Gradient Descent in Wasserstein Space
di: Bonet, Clément, et al.
Pubblicazione: (2024)

Relaxation-Informed Training of Neural Network Surrogate Models
di: Tsay, Calvin
Pubblicazione: (2026)

Adaptive Momentum and Nonlinear Damping for Neural Network Training
di: Karoni, Aikaterini, et al.
Pubblicazione: (2026)

Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent
di: Zhang, Gavin, et al.
Pubblicazione: (2023)

Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse
di: Jacot, Arthur, et al.
Pubblicazione: (2024)

Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives
di: Oikonomidis, Konstantinos, et al.
Pubblicazione: (2026)

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
di: Köhne, Frederik, et al.
Pubblicazione: (2023)

SGD with Adaptive Preconditioning: Unified Analysis and Momentum Acceleration
di: Kovalev, Dmitry
Pubblicazione: (2025)

Monotone Optimisation with Learned Projections
di: Rashwan, Ahmed, et al.
Pubblicazione: (2026)

Compression-aware Training of Neural Networks using Frank-Wolfe
di: Zimmer, Max, et al.
Pubblicazione: (2022)

Randomized Geometric Algebra Methods for Convex Neural Networks
di: Wang, Yifei, et al.
Pubblicazione: (2024)

Upper-Linearizability of Online Non-Monotone DR-Submodular Maximization over Down-Closed Convex Sets
di: Lu, Yiyang, et al.
Pubblicazione: (2026)

Partition of Unity Neural Networks for Interpretable Classification with Explicit Class Regions
di: Aldroubi, Akram
Pubblicazione: (2026)

Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functions
di: Binois, Mickael, et al.
Pubblicazione: (2025)

Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization
di: Zhang, Gavin, et al.
Pubblicazione: (2025)

Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate
di: Pham, Hung, et al.
Pubblicazione: (2025)

Optimization Over Trained Neural Networks: Taking a Relaxing Walk
di: Tong, Jiatai, et al.
Pubblicazione: (2024)

Towards Guided Descent: Optimization Algorithms for Training Neural Networks At Scale
di: Nagwekar, Ansh
Pubblicazione: (2025)

Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks
di: Tucat, Matteo, et al.
Pubblicazione: (2024)

Convex Formulations for Training Two-Layer ReLU Neural Networks
di: Prakhya, Karthik, et al.
Pubblicazione: (2024)

Neural Network Training Techniques Regularize Optimization Trajectory: An Empirical Study
di: Chen, Cheng, et al.
Pubblicazione: (2020)

Dual Natural Gradient Descent for Scalable Training of Physics-Informed Neural Networks
di: Jnini, Anas, et al.
Pubblicazione: (2025)