Cover Image

Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier Features

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kammonen, Aku, Liang, Lisi, Pandey, Anamika, Tempone, Raúl
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Adaptive Random Fourier Features approach Applied to Learning Stochastic Differential Equations
by: Douglas, Owen, et al.
Published: (2025)

Adaptive Random Fourier Features Training Stabilized By Resampling With Applications in Image Regression
by: Kammonen, Aku, et al.
Published: (2024)

Convergence for adaptive resampling of random Fourier features
by: Huang, Xin, et al.
Published: (2025)

Deep NURBS -- Admissible Physics-informed Neural Networks
by: Saidaoui, Hamed, et al.
Published: (2022)

Global Convergence of SGD On Two Layer Neural Nets
by: Gopalani, Pulkit, et al.
Published: (2022)

Differential Privacy in Two-Layer Networks: How DP-SGD Harms Fairness and Robustness
by: Xu, Ruichen, et al.
Published: (2026)

Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold
by: Rupa, Anamika Paul
Published: (2026)

Global Convergence of SGD For Logistic Loss on Two Layer Neural Nets
by: Gopalani, Pulkit, et al.
Published: (2023)

Residual Multi-Fidelity Neural Network Computing
by: Davis, Owen, et al.
Published: (2023)

Feature Learning in Linear-Width Two-Layer Networks: Two vs. One Step of Gradient Descent
by: Moniri, Behrad, et al.
Published: (2026)

Feature Repulsion and Spectral Lock-in: An Empirical Study of Two-Layer Network Grokking
by: Xu, Yongzhong
Published: (2026)

Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networks
by: Li, Binghui, et al.
Published: (2024)

Random Fourier Signature Features
by: Toth, Csaba, et al.
Published: (2023)

Fourier Feature Pyramids for Physics-Informed Neural Networks
by: Zhao, Brandon, et al.
Published: (2026)

Adaptive Branch Specialization in Spectral-Spatial Graph Neural Networks for Certified Robustness
by: Choi, Yoonhyuk, et al.
Published: (2025)

A Unified Stability Analysis of SAM vs SGD: Role of Data Coherence and Emergence of Simplicity Bias
by: Chang, Wei-Kai, et al.
Published: (2025)

Comparing Methods for Bias Mitigation in Graph Neural Networks
by: Hoffmann, Barbara, et al.
Published: (2025)

Enhancing Kernel Power K-means: Scalable and Robust Clustering with Random Fourier Features and Possibilistic Method
by: Chen, Yixi, et al.
Published: (2025)

Random Spiking Neural Networks are Stable and Spectrally Simple
by: Araya, Ernesto, et al.
Published: (2025)

Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
by: Lu, Jiahao
Published: (2025)

ANOVA-boosting for Random Fourier Features
by: Potts, Daniel, et al.
Published: (2024)

Iterative Training of Physics-Informed Neural Networks with Fourier-enhanced Features
by: Wu, Yulun, et al.
Published: (2025)

Robust Fourier Neural Networks
by: Jeong, Halyun, et al.
Published: (2024)

Computational-Statistical Trade-off in Kernel Two-Sample Testing with Random Fourier Features
by: Choi, Ikjun, et al.
Published: (2024)

The Rich and the Simple: On the Implicit Bias of Adam and SGD
by: Vasudeva, Bhavya, et al.
Published: (2025)

A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks
by: Moniri, Behrad, et al.
Published: (2023)

MeixnerNet: Adaptive and Robust Spectral Graph Neural Networks with Discrete Orthogonal Polynomials
by: Goksu, Huseyin
Published: (2025)

DeepDefense: Layer-Wise Gradient-Feature Alignment for Building Robust Neural Networks
by: Lin, Ci, et al.
Published: (2025)

Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training
by: Sander, Tom, et al.
Published: (2024)

Increasing Missingness to Reduce Bias: Richardson-SGD with Missing Data
by: Genans, Ferdinand, et al.
Published: (2026)

Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning
by: Vyas, Nikhil, et al.
Published: (2023)

SGD with Partial Hessian for Deep Neural Networks Optimization
by: Sun, Ying, et al.
Published: (2024)

Rethinking Benign Overfitting in Two-Layer Neural Networks
by: Xu, Ruichen, et al.
Published: (2025)

From SGD to Spectra: A Theory of Neural Network Weight Dynamics
by: Olsen, Brian Richard, et al.
Published: (2025)

SGD and Weight Decay Secretly Minimize the Rank of Your Neural Network
by: Galanti, Tomer, et al.
Published: (2022)

Invertible Kernel PCA with Random Fourier Features
by: Gedon, Daniel, et al.
Published: (2023)

Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential
by: Zhang, Shijun, et al.
Published: (2025)

How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks
by: Zhou, Mo, et al.
Published: (2024)

Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training
by: Jain, Anchit, et al.
Published: (2024)

Simplicity Bias of Two-Layer Networks beyond Linearly Separable Data
by: Tsoy, Nikita, et al.
Published: (2024)