Cover Image

From Taylor Series to Fourier Synthesis: The Periodic Linear Unit

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kudo, Shiko
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Numerical Analysis Neural and Evolutionary Computing 68T07 (Primary) 42A10, 41A30, 65D15 (Secondary) I.5.1; G.1.2; G.1.6; I.2.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Non-convex cost functionals in boosting algorithms and methods for panel selection
by: Visentin, Marco
Published: (2001)

An in-depth look at approximation via deep and narrow neural networks
by: Dommel, Joris, et al.
Published: (2025)

On the Principles of ReLU Networks with One Hidden Layer
by: Huang, Changcun
Published: (2024)

NeurOptimisation: The Spiking Way to Evolve
by: Cruz-Duarte, Jorge Mario, et al.
Published: (2025)

Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates
by: Fokam, Cabrel Teguemne, et al.
Published: (2024)

Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing
by: Sharma, Paras
Published: (2026)

Divergence-free Linearized Neural Networks: Integral Representation and Optimal Approximation Rates
by: He, Juncai, et al.
Published: (2026)

Polyharmonic Spline Packages: Composition, Efficient Procedures for Computation and Differentiation
by: Bakhvalov, Yuriy N.
Published: (2025)

Scalable Nested Optimization for Deep Learning
by: Lorraine, Jonathan
Published: (2024)

CAO: Curvature-Adaptive Optimization via Periodic Low-Rank Hessian Sketching
by: Du, Wenzhang
Published: (2025)

Model Input-Output Configuration Search with Embedded Feature Selection for Sensor Time-series and Image Classification
by: Hoang, Anh T., et al.
Published: (2023)

Deep Neural Networks with General Activations: Super-Convergence in Sobolev Norms
by: Yang, Yahong, et al.
Published: (2025)

Enhanced Protein Intrinsic Disorder Prediction Through Dual-View Multiscale Features and Multi-objective Evolutionary Algorithm
by: Wang, Shaokuan, et al.
Published: (2026)

Active Learning for Conditional Generative Compressed Sensing
by: DeLise, Alexander, et al.
Published: (2026)

Hybrid activation functions for deep neural networks: S3 and S4 -- a novel approach to gradient flow optimization
by: Kavun, Sergii
Published: (2025)

VORT: Adaptive Power-Law Memory for NLP Transformers
by: Mlaiki, Nabil
Published: (2026)

Local properties of neural networks through the lens of layer-wise Hessians
by: Bolshim, Maxim, et al.
Published: (2025)

ZetA: A Riemann Zeta-Scaled Extension of Adam for Deep Learning
by: BC, Samiksha
Published: (2025)

Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures
by: Bolshim, Maxim, et al.
Published: (2026)

Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
by: Bolshim, Maxim, et al.
Published: (2026)

Learning Hamiltonian flows from numerical integrators and examples
by: Fang, Rui, et al.
Published: (2025)

The Hidden Linear Structure in Score-Based Models and its Application
by: Wang, Binxu, et al.
Published: (2023)

Alternately-optimized SNN method for acoustic scattering problem in unbounded domain
by: Song, Haoming, et al.
Published: (2025)

Total Generalized Variation regularization closes the gap between neural-eld and classical methods in seismic travel-time tomography
by: Kurosawa, Isao
Published: (2026)

Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization
by: Li, Weizhao, et al.
Published: (2026)

Contraction, Criticality, and Capacity: A Dynamical-Systems Perspective on Echo-State Networks
by: Singh, Pradeep, et al.
Published: (2025)

On the Convergence and Stability of Upside-Down Reinforcement Learning, Goal-Conditioned Supervised Learning, and Online Decision Transformers
by: Štrupl, Miroslav, et al.
Published: (2025)

Compressive sensing inspired self-supervised single-pixel imaging
by: Lu, Jijun, et al.
Published: (2026)

JacNet: Learning Functions with Structured Jacobians
by: Lorraine, Jonathan, et al.
Published: (2024)

EchoLSTM: A Self-Reflective Recurrent Network for Stabilizing Long-Range Memory
by: K, Prasanth K, et al.
Published: (2025)

Polyharmonic Cascade
by: Bakhvalov, Yuriy N.
Published: (2025)

Task-Synchronized Recurrent Neural Networks
by: Lukoševičius, Mantas, et al.
Published: (2022)

Spiking Neural Networks for SAR Interferometric Phase Unwrapping: A Theoretical Framework for Energy-Efficient Processing
by: Bara, Marc
Published: (2025)

Spiking Sequence Machines and Transformers
by: Bose, Joy
Published: (2026)

Ghosts of Softmax: Complex Singularities That Limit Safe Step Sizes in Cross-Entropy
by: Sao, Piyush
Published: (2026)

Challenges in automatic differentiation and numerical integration in physics-informed neural networks modelling
by: Daněk, Josef, et al.
Published: (2024)

Understanding Two-Layer Neural Networks with Smooth Activation Functions
by: Huang, Changcun
Published: (2025)

Collocation-based Robust Physics Informed Neural Networks for time-dependent simulations of pollution propagation under thermal inversion conditions on Spitsbergen
by: Siwik, Leszek, et al.
Published: (2026)

Perforated Neural Networks for Keyword Spotting
by: Gopal, Vishy, et al.
Published: (2026)

mlx-snn: Spiking Neural Networks on Apple Silicon via MLX
by: Qin, Jiahao
Published: (2026)