Cover Image

Why Shallow Networks Struggle to Approximate and Learn High Frequencies

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Shijun, Zhao, Hongkai, Zhong, Yimin, Zhou, Haomin
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Numerical Analysis
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Structured and Balanced Multi-Component and Multi-Layer Neural Networks
by: Zhang, Shijun, et al.
Published: (2024)

Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential
by: Zhang, Shijun, et al.
Published: (2025)

Multigrade Neural Network Approximation
by: Zhang, Shijun, et al.
Published: (2026)

Geometric Layer-wise Approximation Rates for Deep Networks
by: Zhang, Shijun, et al.
Published: (2026)

What Can One Expect When Solving PDEs Using Shallow Neural Networks?
by: He, Roy Y., et al.
Published: (2025)

From Frequency Bias to Spectral Balance: Operator-Aware Preconditioners for PINNs
by: He, Roy Y., et al.
Published: (2026)

Condition Numbers and Eigenvalue Spectra of Shallow Networks on Spheres
by: Liu, Xinliang, et al.
Published: (2025)

Expressive Power of Deep Networks on Manifolds: Simultaneous Approximation
by: Zhou, Hanfei, et al.
Published: (2025)

Finite Samples for Shallow Neural Networks
by: Xia, Yu, et al.
Published: (2025)

Robustness of data-driven approaches in limited angle tomography
by: Wang, Yiran, et al.
Published: (2024)

A Deep Learning Framework for Multi-Operator Learning: Architectures and Approximation Theory
by: Weihs, Adrien, et al.
Published: (2025)

Sinusoidal Approximation Theorem for Kolmogorov-Arnold Networks
by: Gleyzer, Sergei, et al.
Published: (2025)

A novel algorithm for the decomposition of non-stationary multidimensional and multivariate signals
by: Cavassi, Roberto, et al.
Published: (2024)

Coseparable Nonnegative Tensor Factorization With T-CUR Decomposition
by: Chen, Juefei, et al.
Published: (2024)

Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning
by: Mustajab, Abdul Hannan, et al.
Published: (2024)

Deep Parallel Spectral Neural Operators for Solving Partial Differential Equations with Enhanced Low-Frequency Learning Capability
by: Ma, Qinglong, et al.
Published: (2024)

Approximation Power of Deep Neural Networks: an explanatory mathematical survey
by: Davis, Owen, et al.
Published: (2022)

Multi-scale DeepOnet (Mscale-DeepOnet) for Mitigating Spectral Bias in Learning High Frequency Operators of Oscillatory Functions
by: Wang, Bo, et al.
Published: (2025)

On the Dimension-Free Approximation of Deep Neural Networks for Symmetric Korobov Functions
by: Lu, Yulong, et al.
Published: (2025)

Operator SVD with Neural Networks via Nested Low-Rank Approximation
by: Ryu, J. Jon, et al.
Published: (2024)

Sobolev Approximation of Deep ReLU Networks in Log-Barron Space
by: Song, Changhoon, et al.
Published: (2026)

Approximation with SiLU Networks: Constant Depth and Exponential Rates for Basic Operations
by: Ayena, Koffi O.
Published: (2025)

A Probabilistic Framework for Solving High-Frequency Helmholtz Equations via Diffusion Models
by: Zou, Yicheng, et al.
Published: (2026)

Physics-informed Discretization-independent Deep Compositional Operator Network
by: Zhong, Weiheng, et al.
Published: (2024)

An Efficient Deep Learning Approach for Approximating Parameter-to-Solution Maps of PDEs
by: Lei, Guanhang, et al.
Published: (2024)

Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs
by: Yang, Zherui, et al.
Published: (2025)

Are Deep Learning Based Hybrid PDE Solvers Reliable? Why Training Paradigms and Update Strategies Matter
by: Wu, Yuhan, et al.
Published: (2026)

Why Cannot Neural Networks Master Extrapolation? Insights from Physical Laws
by: Dakhmouche, Ramzi, et al.
Published: (2025)

Higher Order Approximation Rates for ReLU CNNs in Korobov Spaces
by: Li, Yuwen, et al.
Published: (2025)

Is the Frequency Principle always valid?
by: Zhai, Qijia
Published: (2025)

ChebNet: Efficient and Stable Constructions of Deep Neural Networks with Rectified Power Units via Chebyshev Approximations
by: Tang, Shanshan, et al.
Published: (2019)

Approximation properties of neural ODEs
by: De Marinis, Arturo, et al.
Published: (2025)

Data-Driven Approximation of Binary-State Network Reliability Function: Algorithm Selection and Reliability Thresholds for Large-Scale Systems
by: Yeh, Wei-Chang
Published: (2025)

Variational Matrix-Learning Fourier Networks for Parametric Multiphysics Surrogates
by: Li, Xinyu, et al.
Published: (2026)

Optimal Approximation of Zonoids and Uniform Approximation by Shallow Neural Networks
by: Siegel, Jonathan W.
Published: (2023)

Learning Stochastic Dynamical Systems with Structured Noise
by: Guo, Ziheng, et al.
Published: (2025)

Approximation and learning with compositional tensor trains
by: Eigel, Martin, et al.
Published: (2025)

Large Data Limits of Laplace Learning for Gaussian Measure Data in Infinite Dimensions
by: Zhong, Zhengang, et al.
Published: (2026)

Approximation by non-symmetric networks for cross-domain learning
by: Mhaskar, Hrushikesh
Published: (2023)

Guaranteed Approximation Bounds for Mixed-Precision Neural Operators
by: Tu, Renbo, et al.
Published: (2023)