Imagen de Portada

Dual Natural Gradient Descent for Scalable Training of Physics-Informed Neural Networks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jnini, Anas, Vella, Flavio
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Gauss-Newton Natural Gradient Descent for Physics-Informed Computational Fluid Dynamics
por: Jnini, Anas, et al.
Publicado: (2024)

Dual Cone Gradient Descent for Training Physics-Informed Neural Networks
por: Hwang, Youngsik, et al.
Publicado: (2024)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
por: Xu, Xianliang, et al.
Publicado: (2024)

Riemann Tensor Neural Networks: Learning Conservative Systems with Physics-Constrained Networks
por: Jnini, Anas, et al.
Publicado: (2025)

Curvature-Aware Optimization for High-Accuracy Physics-Informed Neural Networks
por: Jnini, Anas, et al.
Publicado: (2026)

Convergence of Gradient Descent for Recurrent Neural Networks: A Nonasymptotic Analysis
por: Cayci, Semih, et al.
Publicado: (2024)

Gauss-Newton Natural Gradient Descent for Shape Learning
por: King, James, et al.
Publicado: (2026)

Non-Singularity of the Gradient Descent map for Neural Networks with Piecewise Analytic Activations
por: Crăciun, Alexandru, et al.
Publicado: (2025)

Convergence Properties of Natural Gradient Descent for Minimizing KL Divergence
por: Datar, Adwait, et al.
Publicado: (2025)

Towards Guided Descent: Optimization Algorithms for Training Neural Networks At Scale
por: Nagwekar, Ansh
Publicado: (2025)

Stochastic Adaptive Gradient Descent Without Descent
por: Aujol, Jean-François, et al.
Publicado: (2025)

Corner Gradient Descent
por: Yarotsky, Dmitry
Publicado: (2025)

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations
por: Liu, Shu, et al.
Publicado: (2024)

Reconstructing Physics-Informed Machine Learning for Traffic Flow Modeling: a Multi-Gradient Descent and Pareto Learning Approach
por: Lei, Yuan-Zheng, et al.
Publicado: (2025)

Enhancing Stability of Physics-Informed Neural Network Training Through Saddle-Point Reformulation
por: Bylinkin, Dmitry, et al.
Publicado: (2025)

Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks
por: Cai, Yuhang, et al.
Publicado: (2025)

Relaxation-Informed Training of Neural Network Surrogate Models
por: Tsay, Calvin
Publicado: (2026)

Adaptive Conditional Gradient Descent
por: Khademi, Abbas, et al.
Publicado: (2025)

$k$-SVD with Gradient Descent
por: Jedra, Yassir, et al.
Publicado: (2025)

Solving Inverse Problems with Deep Linear Neural Networks: Global Convergence Guarantees for Gradient Descent with Weight Decay
por: Laus, Hannah, et al.
Publicado: (2025)

Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
por: Beneventano, Pierfrancesco, et al.
Publicado: (2025)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
por: Lai, Kuo-Wei, et al.
Publicado: (2026)

Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks
por: Tucat, Matteo, et al.
Publicado: (2024)

Stochastic Gradient Descent with Strategic Querying
por: Jiang, Nanfei, et al.
Publicado: (2025)

Stochastic Gradient Descent with Adaptive Data
por: Che, Ethan, et al.
Publicado: (2024)

Unraveling the Gradient Descent Dynamics of Transformers
por: Song, Bingqing, et al.
Publicado: (2024)

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization
por: Zhu, Yuchen, et al.
Publicado: (2024)

Learning Provably Improves the Convergence of Gradient Descent
por: Song, Qingyu, et al.
Publicado: (2025)

Enhancing Fractional Gradient Descent with Learned Optimizers
por: Sobotka, Jan, et al.
Publicado: (2025)

Mirror and Preconditioned Gradient Descent in Wasserstein Space
por: Bonet, Clément, et al.
Publicado: (2024)

Derivatives of Stochastic Gradient Descent in parametric optimization
por: Iutzeler, Franck, et al.
Publicado: (2024)

Convergence of Alternating Gradient Descent for Matrix Factorization
por: Ward, Rachel, et al.
Publicado: (2023)

On Penalty-based Bilevel Gradient Descent Method
por: Shen, Han, et al.
Publicado: (2023)

A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models
por: Xu, Ziqing, et al.
Publicado: (2025)

Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law
por: Kunstner, Frederik, et al.
Publicado: (2025)

Physics-Informed Neural Networks with Hard Linear Equality Constraints
por: Chen, Hao, et al.
Publicado: (2024)

On the Inherent Privacy of Zeroth Order Projected Gradient Descent
por: Gupta, Devansh, et al.
Publicado: (2025)

On the Convergence of Gradient Descent on Learning Transformers with Residual Connections
por: Qin, Zhen, et al.
Publicado: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
por: Li, Tianyou, et al.
Publicado: (2023)