Cover Image

Shrinkage Initialization for Smooth Learning of Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cheng, Miao, Zhou, Feiyan, Zou, Hongwei, Wang, Limin
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Neural and Evolutionary Computing I.2.6; F.2.1
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Full Domain Analysis in Fluid Dynamics
by: Hagg, Alexander, et al.
Published: (2025)

Deep Convolutional Autoencoder for Assessment of Drive-Cycle Anomalies in Connected Vehicle Sensor Data
by: Geglio, Anthony, et al.
Published: (2022)

Theoretical Analysis of the Advantage of Deepening Neural Networks
by: Esaki, Yasushi, et al.
Published: (2020)

Shapley Value-Guided Adaptive Ensemble Learning for Explainable Financial Fraud Detection with U.S. Regulatory Compliance Validation
by: Uddin, Mohammad Nasir, et al.
Published: (2026)

Symbolic Neural Generation with Applications to Lead Discovery in Drug Design
by: Srinivasan, Ashwin, et al.
Published: (2025)

IP$^{2}$-RSNN: Bi-level Intrinsic Plasticity Enables Learning-to-learn in Recurrent Spiking Neural Networks
by: Yu, Yingchao, et al.
Published: (2025)

Towards Scaling Deep Neural Networks with Predictive Coding: Theory and Practice
by: Innocenti, Francesco
Published: (2025)

Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks
by: Nouranizadeh, Amirhossein, et al.
Published: (2024)

Introducing Echo Networks for Computational Neuroevolution
by: Kroos, Christian, et al.
Published: (2026)

Evolving Deep Learning Optimizers
by: Marfinetz, Mitchell
Published: (2025)

Extending Spike-Timing Dependent Plasticity to Learning Synaptic Delays
by: Dominijanni, Marissa, et al.
Published: (2025)

Multi-Marginal Stochastic Flow Matching for High-Dimensional Snapshot Data at Irregular Time Points
by: Lee, Justin, et al.
Published: (2025)

Collapse or Preserve: Data-Dependent Temporal Aggregation for Spiking Neural Network Acceleration
by: Qin, Jiahao
Published: (2026)

Controlling Recurrent Neural Networks by Conceptors
by: Jaeger, Herbert
Published: (2014)

Reward-Modulated Local Learning in Spiking Encoders: Controlled Benchmarks with STDP and Hybrid Rate Readouts
by: Chakraborty, Debjyoti
Published: (2026)

Multi-objective Binary Coordinate Search for Feature Selection
by: Miyandoab, Sevil Zanjani, et al.
Published: (2024)

Batchless Normalization: How to Normalize Activations Across Instances with Minimal Memory Requirements
by: Berger, Benjamin, et al.
Published: (2022)

Evaluating Brain-Inspired Modular Training in Automated Circuit Discovery for Mechanistic Interpretability
by: Nainani, Jatin
Published: (2024)

Compact NSGA-II for Multi-objective Feature Selection
by: Miyandoab, Sevil Zanjani, et al.
Published: (2024)

Increasing biases can be more efficient than increasing weights
by: Metta, Carlo, et al.
Published: (2023)

GAAPO: Genetic Algorithmic Applied to Prompt Optimization
by: Sécheresse, Xavier, et al.
Published: (2025)

Game-Theoretic Gradient Control for Robust Neural Network Training
by: Zaitseva, Maria, et al.
Published: (2025)

Efficient and Flexible Neural Network Training through Layer-wise Feedback Propagation
by: Weber, Leander, et al.
Published: (2023)

A Technical Note on the Architectural Effects on Maximum Dependency Lengths of Recurrent Neural Networks
by: Kent, Jonathan S., et al.
Published: (2024)

K-Way Energy Probes for Metacognition Reduce to Softmax in Discriminative Predictive Coding Networks
by: Cacioli, Jon-Paul
Published: (2026)

Decoding Rewards in Competitive Games: Inverse Game Theory with Entropy Regularization
by: Liao, Junyi, et al.
Published: (2026)

SPARTA: Advancing Sparse Attention in Spiking Neural Networks via Spike-Timing-Based Prioritization
by: Jang, Minsuk, et al.
Published: (2025)

Isotropic Activation Functions Enable Deindividuated Neurons and Adaptive Topologies
by: Bird, George
Published: (2026)

On the Infinite Width and Depth Limits of Predictive Coding Networks
by: Innocenti, Francesco, et al.
Published: (2026)

Enhanced Protein Intrinsic Disorder Prediction Through Dual-View Multiscale Features and Multi-objective Evolutionary Algorithm
by: Wang, Shaokuan, et al.
Published: (2026)

Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?
by: Innocenti, Francesco, et al.
Published: (2024)

$μ$PC: Scaling Predictive Coding to 100+ Layer Networks
by: Innocenti, Francesco, et al.
Published: (2025)

Neural Attention: A Novel Mechanism for Enhanced Expressive Power in Transformer Models
by: DiGiugno, Andrew, et al.
Published: (2025)

Graph Coloring for Multi-Task Learning
by: Patapati, Santosh
Published: (2025)

Neuromorphic Parameter Estimation for Power Converter Health Monitoring Using Spiking Neural Networks
by: Baik, Hyeongmeen, et al.
Published: (2026)

Combining Trained Models in Reinforcement Learning
by: Patil, Ujjwal, et al.
Published: (2026)

Expanding continual few-shot learning benchmarks to include recognition of specific instances
by: Kowadlo, Gideon, et al.
Published: (2022)

Kolmogorov Arnold Networks and Multi-Layer Perceptrons: A Paradigm Shift in Neural Modelling
by: Gaonkar, Aradhya, et al.
Published: (2026)

Spiking Neural Network Architecture Search: A Survey
by: Svoboda, Kama, et al.
Published: (2025)

Efficient NAS with FaDE on Hierarchical Spaces
by: Neumeyer, Simon, et al.
Published: (2024)