Image de couverture de livre

Loss Jump During Loss Switch in Solving PDEs with Neural Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Zhiwei, Zhang, Lulu, Zhang, Zhongwang, Xu, Zhi-Qin John
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Mathematical Physics
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Loss Spike in Training Neural Networks
par: Li, Xiaolong, et autres
Publié: (2023)

Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks
par: Bai, Zhiwei, et autres
Publié: (2022)

The Loss Surfaces of Neural Networks with General Activation Functions
par: Baskerville, Nicholas P., et autres
Publié: (2020)

Chebyshev Spectral Neural Networks for Solving Partial Differential Equations
par: Yin, Pengsong, et autres
Publié: (2024)

Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization
par: Zhang, Yaoyu, et autres
Publié: (2024)

Neumann Series-based Neural Operator for Solving Inverse Medium Problem
par: Liu, Ziyang, et autres
Publié: (2024)

Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing
par: Zhang, Zhongwang, et autres
Publié: (2024)

Efficient High-Accuracy PDEs Solver with the Linear Attention Neural Operator
par: Zhong, Ming, et autres
Publié: (2025)

Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers
par: Zhang, Zhongwang, et autres
Publié: (2025)

DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modeling
par: Zang, Yaohua, et autres
Publié: (2025)

Physics-Informed Neural Networks for Solving Derivative-Constrained PDEs
par: Hoshisashi, Kentaro, et autres
Publié: (2026)

Efficient Error Certification for Physics-Informed Neural Networks
par: Eiras, Francisco, et autres
Publié: (2023)

Symbolic Neural Ordinary Differential Equations
par: Li, Xin, et autres
Publié: (2025)

Reasoning Bias of Next Token Prediction Training
par: Lin, Pengxiao, et autres
Publié: (2025)

An Analysis for Reasoning Bias of Language Models with Small Initialization
par: Yao, Junjie, et autres
Publié: (2025)

QCPINN: Quantum-Classical Physics-Informed Neural Networks for Solving PDEs
par: Farea, Afrah, et autres
Publié: (2025)

Symmetry Breaking in Neural Network Optimization: Insights from Input Dimension Expansion
par: Zhang, Jun-Jie, et autres
Publié: (2024)

UGrid: An Efficient-And-Rigorous Neural Multigrid Solver for Linear PDEs
par: Han, Xi, et autres
Publié: (2024)

Solving Partial Differential Equations in Different Domains by Operator Learning method Based on Boundary Integral Equations
par: Meng, Bin, et autres
Publié: (2024)

Adaptive Preconditioners Trigger Loss Spikes in Adam
par: Bai, Zhiwei, et autres
Publié: (2025)

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations
par: Wang, Sen, et autres
Publié: (2024)

Hamiltonian Graph Inference Networks: Joint structure discovery and dynamics prediction for lattice Hamiltonian systems from trajectory data
par: Geng, Ru, et autres
Publié: (2026)

Walsh-Hadamard Neural Operators for Solving PDEs with Discontinuous Coefficients
par: Cavallazzi, Giorgio M., et autres
Publié: (2025)

Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism
par: Wang, Zhiwei, et autres
Publié: (2024)

A Unified Theory of Quantum Neural Network Loss Landscapes
par: Anschuetz, Eric R.
Publié: (2024)

Domain-Decomposed Graph Neural Network Surrogate Modeling for Ice Sheets
par: Propp, Adrienne M., et autres
Publié: (2025)

FEKAN: Feature-Enriched Kolmogorov-Arnold Networks
par: Menon, Sidharth S., et autres
Publié: (2026)

Retrofitting Earth System Models with Cadence-Limited Neural Operator Updates
par: Bora, Aniruddha, et autres
Publié: (2025)

Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation law
par: Zhang, Jingdong, et autres
Publié: (2024)

Transfer Learning on Multi-Dimensional Data: A Novel Approach to Neural Network-Based Surrogate Modeling
par: Propp, Adrienne M., et autres
Publié: (2024)

Anchor function: a type of benchmark functions for studying language models
par: Zhang, Zhongwang, et autres
Publié: (2024)

Deep Neural Networks as the Semi-classical Limit of Topological Quantum Neural Networks: The problem of generalisation
par: Marciano, Antonino, et autres
Publié: (2022)

Loss-Complexity Landscape and Model Structure Functions
par: Kolpakov, Alexander
Publié: (2025)

Accelerated Airfoil Design Using Neural Network Approaches
par: Patel, Anantram, et autres
Publié: (2025)

Symbolic identification of tensor equations in multidimensional physical fields
par: Chen, Tianyi, et autres
Publié: (2025)

Solution of the Probabilistic Lambert Problem: Connections with Optimal Mass Transport, Schrödinger Bridge and Reaction-Diffusion PDEs
par: Teter, Alexis M. H., et autres
Publié: (2024)

PO-CKAN:Physics Informed Deep Operator Kolmogorov Arnold Networks with Chunk Rational Structure
par: Wu, Junyi, et autres
Publié: (2025)

Finite Element Neural Network Interpolation. Part I: Interpretable and Adaptive Discretization for Solving PDEs
par: Škardová, Kateřina, et autres
Publié: (2024)

Classification with Deep Neural Networks and Logistic Loss
par: Zhang, Zihan, et autres
Publié: (2023)

BridgeNet: A Hybrid, Physics-Informed Machine Learning Framework for Solving High-Dimensional Fokker-Planck Equations
par: Mirzabeigi, Elmira, et autres
Publié: (2025)