Cover Image

Communication Dynamics Neural Networks: FFT-Diagonalized Layers for Improved Hessian Conditioning at Reduced Parameter Count

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Pan, Lurong
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning
by: Elsayed, Mohamed, et al.
Published: (2024)

Dynamic Layer Tying for Parameter-Efficient Transformers
by: Hay, Tamir David, et al.
Published: (2024)

Dynamic Continual Learning: Harnessing Parameter Uncertainty for Improved Network Adaptation
by: Angelini, Christopher, et al.
Published: (2025)

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization
by: Zhao, Huaqin, et al.
Published: (2024)

Diagonal Adaptive Non-local Observables on Quantum Neural Networks
by: Tseng, Huan-Hsin, et al.
Published: (2026)

LAPLEX: The FFT of Learnable Laplace Kernels
by: Struski, Łukasz, et al.
Published: (2026)

Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformation
by: Ham, Seokil, et al.
Published: (2024)

Symmetry in Neural Network Parameter Spaces
by: Zhao, Bo, et al.
Published: (2025)

FFT-based Dynamic Subspace Selection for Low-Rank Adaptive Optimization of Large Language Models
by: Modoranu, Ionut-Vlad, et al.
Published: (2025)

HeRo-Q: A General Framework for Stable Low Bit Quantization via Hessian Conditioning
by: Zhang, Jinhao Zhang Yunquan, et al.
Published: (2026)

Flow to Learn: Flow Matching on Neural Network Parameters
by: Saragih, Daniel, et al.
Published: (2025)

Ray-Tracing for Conditionally Activated Neural Networks
by: Gallicchio, Claudio, et al.
Published: (2025)

Beyond Parameter Count: Implicit Bias in Soft Mixture of Experts
by: Chung, Youngseog, et al.
Published: (2024)

Layer Embedding Deep Fusion Graph Neural Network
by: Xu, Taihua, et al.
Published: (2026)

Compressing Neural Networks Using Tensor Networks with Exponentially Fewer Variational Parameters
by: Qing, Yong, et al.
Published: (2023)

Bayesian Neural Network For Personalized Federated Learning Parameter Selection
by: Luo, Mengen, et al.
Published: (2024)

Latent Communication in Artificial Neural Networks
by: Moschella, Luca
Published: (2024)

Symbol Correctness in Deep Neural Networks Containing Symbolic Layers
by: Bembenek, Aaron, et al.
Published: (2024)

Hessian-Free Online Certified Unlearning
by: Qiao, Xinbao, et al.
Published: (2024)

Conditional LoRA Parameter Generation
by: Jin, Xiaolong, et al.
Published: (2024)

INSPIRE-GNN: Intelligent Sensor Placement to Improve Sparse Bicycling Network Prediction via Reinforcement Learning Boosted Graph Neural Networks
by: Gupta, Mohit, et al.
Published: (2025)

SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression
by: Xie, Qihu, et al.
Published: (2025)

Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset
by: Galashov, Alexandre, et al.
Published: (2024)

Neural Inhibition Improves Dynamic Routing and Mixture of Experts
by: Zou, Will Y., et al.
Published: (2025)

Flow-Induced Diagonal Gaussian Processes
by: Lin, Moule, et al.
Published: (2025)

Neural Network Parameter-optimization of Gaussian pmDAGs
by: Saremi, Mehrzad
Published: (2023)

SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints
by: Chu, Ya-Chi, et al.
Published: (2026)

The Hidden Power of Normalization Layers in Neural Networks: Exponential Capacity Control
by: Than, Khoat
Published: (2025)

SplitQuant: Layer Splitting for Low-Bit Neural Network Quantization
by: Song, Jaewoo, et al.
Published: (2025)

Reduce Computational Complexity for Convolutional Layers by Skipping Zeros
by: Zhang, Zhiyi, et al.
Published: (2023)

DynaMoE: Dynamic Token-Level Expert Activation with Layer-Wise Adaptive Capacity for Mixture-of-Experts Neural Networks
by: Gülmez, Gökdeniz
Published: (2026)

On the Spatiotemporal Dynamics of Generalization in Neural Networks
by: Wei, Zichao
Published: (2026)

Wormhole Dynamics in Deep Neural Networks
by: Lai, Yen-Lung, et al.
Published: (2025)

How to Provably Improve Return Conditioned Supervised Learning?
by: Liu, Zhishuai, et al.
Published: (2025)

Epi$^2$-Net: Advancing Epidemic Dynamics Forecasting with Physics-Inspired Neural Networks
by: Sun, Rui, et al.
Published: (2025)

NdLinear: Preserving Multi-Dimensional Structure for Parameter-Efficient Neural Networks
by: Reneau, Alex, et al.
Published: (2025)

Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization
by: Chaubard, Francois, et al.
Published: (2025)

Puppet-CNN: Continuous Parameter Dynamics for Input-Adaptive Convolutional Networks
by: Xing, Yucheng, et al.
Published: (2024)

Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency
by: Dwyer, Joe
Published: (2026)

Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting
by: Ghaffari, Amirhossein, et al.
Published: (2026)