Cover Image

A Sampling Theory Perspective on Activations for Implicit Neural Representations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Saratchandran, Hemanth, Ramasinghe, Sameera, Shevchenko, Violetta, Long, Alexander, Lucey, Simon
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Activation to Initialization: Scaling Insights for Optimizing Neural Fields
by: Saratchandran, Hemanth, et al.
Published: (2024)

The Inlet Rank Collapse in Implicit Neural Representations: Diagnosis and Unified Remedy
by: Zheng, Jianqiao, et al.
Published: (2026)

Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)

Spectral Conditioning of Attention Improves Transformer Performance
by: Saratchandran, Hemanth, et al.
Published: (2026)

D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2024)

Architectural Strategies for the optimization of Physics-Informed Neural Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)

Preconditioners for the Stochastic Training of Neural Fields
by: Chng, Shin-Fang, et al.
Published: (2024)

Leaner Transformers: More Heads, Less Depth
by: Saratchandran, Hemanth, et al.
Published: (2025)

SineLoRA$Δ$: Sine-Activated Delta Compression
by: Gordon, Cameron, et al.
Published: (2025)

Stable Forgetting: Bounded Parameter-Efficient Unlearning in Foundation Models
by: Garg, Arpit, et al.
Published: (2025)

Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)

Always Skip Attention
by: Ji, Yiping, et al.
Published: (2025)

Preconditioned Attention: Enhancing Efficiency in Transformers
by: Saratchandran, Hemanth
Published: (2026)

The Quantization Benefits of Residual-Free Transformers
by: Ji, Yiping, et al.
Published: (2026)

Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
by: Saratchandran, Hemanth, et al.
Published: (2024)

From Tables to Signals: Revealing Spectral Adaptivity in TabPFN
by: Zheng, Jianqiao, et al.
Published: (2025)

Enhancing Transformers Through Conditioned Embedded Tokens
by: Saratchandran, Hemanth, et al.
Published: (2025)

AsyncMesh: Fully Asynchronous Optimization for Data and Pipeline Parallelism
by: Ajanthan, Thalaiyasingam, et al.
Published: (2026)

SENTINEL: Stagewise Integrity Verification for Pipeline Parallel Decentralized Training
by: Dolatabadi, Hadi Mohaghegh, et al.
Published: (2026)

Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism
by: Ramasinghe, Sameera, et al.
Published: (2025)

NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
by: Dolatabadi, Hadi Mohaghegh, et al.
Published: (2026)

Weight Conditioning for Smooth Optimization of Neural Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)

Cutting the Skip: Training Residual-Free Transformers
by: Ji, Yiping, et al.
Published: (2025)

Nesterov Method for Asynchronous Pipeline Parallel Optimization
by: Ajanthan, Thalaiyasingam, et al.
Published: (2025)

SineProject: Machine Unlearning for Stable Vision Language Alignment
by: Garg, Arpit, et al.
Published: (2025)

Invertible Neural Warp for NeRF
by: Chng, Shin-Fang, et al.
Published: (2024)

Trading Positional Complexity vs. Deepness in Coordinate Networks
by: Zheng, Jianqiao, et al.
Published: (2022)

Neural Experts: Mixture of Experts for Implicit Neural Representations
by: Ben-Shabat, Yizhak, et al.
Published: (2024)

Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting
by: Xu, Runze, et al.
Published: (2026)

Improving Accuracy and Efficiency of Implicit Neural Representations: Making SIREN a WINNER
by: Chandravamsi, Hemanth, et al.
Published: (2025)

Data Denoising and Derivative Estimation for Data-Driven Modeling of Nonlinear Dynamical Systems
by: Yao, Jiaqi, et al.
Published: (2025)

Structured Initialization for Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2025)

VI3NR: Variance Informed Initialization for Implicit Neural Representations
by: Koneputugodage, Chamin Hewa, et al.
Published: (2025)

Transformers Pretrained on Procedural Data Contain Modular Structures for Algorithmic Reasoning
by: Shinnick, Zachary, et al.
Published: (2025)

Gradient Descent as a Shrinkage Operator for Spectral Bias
by: Lucey, Simon
Published: (2025)

Procedural Pretraining: Warming Up Language Models with Abstract Data
by: Jiang, Liangze, et al.
Published: (2026)

Dynamical Implicit Neural Representations
by: Park, Yesom, et al.
Published: (2025)

Temporal Variational Implicit Neural Representations
by: Koyuncu, Batuhan, et al.
Published: (2025)

Understanding NTK Variance in Implicit Neural Representations
by: Ou, Chengguang, et al.
Published: (2025)

Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theorem
by: Qiu, Tianming, et al.
Published: (2026)