Cover Image

How Does Fourier Analysis Network Work? A Mechanism Analysis and a New Dual-Activation Layer Proposal

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jeong, Sam, Kim, Hae Yong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Convolutional Fourier Analysis Network (CFAN): A Unified Time-Frequency Approach for ECG Classification
by: Jeong, Sam, et al.
Published: (2025)

How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks
by: Zhou, Mo, et al.
Published: (2024)

Scalable Geometric Learning with Correlation-Based Functional Brain Networks
by: You, Kisung, et al.
Published: (2025)

FAN: Fourier Analysis Networks
by: Dong, Yihong, et al.
Published: (2024)

Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis
by: Kim, Minjung, et al.
Published: (2024)

Analysis of Fourier Neural Operators via Effective Field Theory
by: Kim, Taeyoung
Published: (2025)

Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanism
by: Xiong, Yuqi, et al.
Published: (2025)

How Does Distribution Matching Help Domain Generalization: An Information-theoretic Analysis
by: Dong, Yuxin, et al.
Published: (2024)

How Does DPO Reduce Toxicity? A Mechanistic Neuron-Level Analysis
by: Yang, Yushi, et al.
Published: (2024)

Robust Fourier Neural Networks
by: Jeong, Halyun, et al.
Published: (2024)

DualDynamics: Synergizing Implicit and Explicit Methods for Robust Irregular Time Series Analysis
by: Oh, YongKyung, et al.
Published: (2024)

Does Graph Prompt Work? A Data Operation Perspective with Theoretical Analysis
by: Wang, Qunzhong, et al.
Published: (2024)

How to sketch a learning algorithm
by: Gunn, Sam
Published: (2026)

Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks
by: Chen, Wenlin, et al.
Published: (2023)

Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential
by: Zhang, Shijun, et al.
Published: (2025)

When Does Removing LayerNorm Help? Activation Bounding as a Regime-Dependent Implicit Regularizer
by: Verma, Lucky
Published: (2026)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
by: Lai, Kuo-Wei, et al.
Published: (2026)

Disentangling Recall and Reasoning in Transformer Models through Layer-wise Attention and Activation Analysis
by: Fartale, Harshwardhan, et al.
Published: (2025)

Deep Learning-Based Survival Analysis with Copula-Based Activation Functions for Multivariate Response Prediction
by: Kim, Jong-Min, et al.
Published: (2025)

How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks?
by: Alon, Gal, et al.
Published: (2025)

How Does Preconditioning Guide Feature Learning in Deep Neural Networks?
by: Yoshida, Kotaro, et al.
Published: (2025)

Unveiling the Potential of BERTopic for Multilingual Fake News Analysis -- Use Case: Covid-19
by: Schäfer, Karla, et al.
Published: (2024)

Fourier Analysis on the Boolean Hypercube via Hoeffding Functional Decomposition
by: Ferrere, Baptiste, et al.
Published: (2025)

Generalization Bounds for Spectral GNNs via Fourier Domain Analysis
by: Martirosyan, Vahan A., et al.
Published: (2026)

An Infinite-Width Analysis on the Jacobian-Regularised Training of a Neural Network
by: Kim, Taeyoung, et al.
Published: (2023)

KAPLAN: Kolmogorov-Arnold Prognostic Learnable Activation Networks for Survival Analysis
by: Logothetis, Stelios Boulitsakis, et al.
Published: (2026)

LI-DSN: A Layer-wise Interactive Dual-Stream Network for EEG Decoding
by: Yue, Chenghao, et al.
Published: (2026)

Cognitive Activation and Chaotic Dynamics in Large Language Models: A Quasi-Lyapunov Analysis of Reasoning Mechanisms
by: Li, Xiaojian, et al.
Published: (2025)

Comparing Spectral Bias and Robustness For Two-Layer Neural Networks: SGD vs Adaptive Random Fourier Features
by: Kammonen, Aku, et al.
Published: (2024)

On the Sample Complexity of Two-Layer Networks: Lipschitz vs. Element-Wise Lipschitz Activation
by: Daniely, Amit, et al.
Published: (2022)

Network Representation Learning for Biophysical Neural Network Analysis
by: Ha, Youngmok, et al.
Published: (2024)

Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysis
by: Pawłowski, Maciej, et al.
Published: (2022)

Neural Networks with Sparse Activation Induced by Large Bias: Tighter Analysis with Bias-Generalized NTK
by: Yang, Hongru, et al.
Published: (2023)

The SuperActivator Mechanism: Transformers Concentrate Reliable Concept Signals in the Tail
by: Goldberg, Cassandra, et al.
Published: (2025)

Taming Gradient Oversmoothing and Expansion in Graph Neural Networks
by: Park, MoonJeong, et al.
Published: (2024)

Why Does RLAIF Work At All?
by: Young, Robin
Published: (2026)

An Analysis of Embedding Layers and Similarity Scores using Siamese Neural Networks
by: Bingi, Yash, et al.
Published: (2023)

Fourier Analysis of Variational Quantum Circuits for Supervised Learning
by: Wiedmann, Marco, et al.
Published: (2024)

How Does Overparameterization Affect Features?
by: Duzgun, Ahmet Cagri, et al.
Published: (2024)

How Two-Layer Neural Networks Learn, One (Giant) Step at a Time
by: Dandi, Yatin, et al.
Published: (2023)