Cover Image

Neural Network Plasticity and Loss Sharpness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Koster, Max, Kukla, Jude
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity
by: Shin, Baekrok, et al.
Published: (2024)

Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss
by: Park, Sangyeon, et al.
Published: (2025)

A Methodology-Oriented Study of Catastrophic Forgetting in Incremental Deep Neural Networks
by: Kumar, Ashutosh, et al.
Published: (2024)

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
by: Elsayed, Mohamed, et al.
Published: (2024)

Plasticity Loss in Deep Reinforcement Learning: A Survey
by: Klein, Timo, et al.
Published: (2024)

Do Neural Networks Lose Plasticity in a Gradually Changing World?
by: Liu, Tianhui, et al.
Published: (2026)

A Study of Plasticity Loss in On-Policy Deep Reinforcement Learning
by: Juliani, Arthur, et al.
Published: (2024)

Barriers for Learning in an Evolving World: Mathematical Understanding of Loss of Plasticity
by: Joudaki, Amir, et al.
Published: (2025)

Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churn
by: Tang, Hongyao, et al.
Published: (2025)

Z-Error Loss for Training Neural Networks
by: Godin, Guillaume
Published: (2025)

Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity
by: Su, Zhiyuan, et al.
Published: (2025)

Causal Graph Neural Networks for Healthcare
by: Mesinovic, Munib, et al.
Published: (2025)

Learning to be Reproducible: Custom Loss Design for Robust Neural Networks
by: Ahmed, Waqas, et al.
Published: (2026)

Deep Manifold Part 2: Neural Network Mathematics
by: Ma, Max Y., et al.
Published: (2025)

Exploring Physics-Informed Neural Networks for Crop Yield Loss Forecasting
by: Miranda, Miro, et al.
Published: (2024)

Heterogeneous Graph Neural Networks with Loss-decrease-aware Curriculum Learning
by: Wang, Yili
Published: (2024)

Physics-Informed Neural Networks with Learnable Loss Balancing and Transfer Learning
by: Pirayeshshirazinezhad, Reza
Published: (2026)

Deep Manifold Part 1: Anatomy of Neural Network Manifold
by: Ma, Max Y., et al.
Published: (2024)

Can We Understand Plasticity Through Neural Collapse?
by: Bonifazi, Guglielmo, et al.
Published: (2024)

Loss Function Considering Dead Zone for Neural Networks
by: Inami, Koki, et al.
Published: (2024)

BARNN: A Bayesian Autoregressive and Recurrent Neural Network
by: Coscia, Dario, et al.
Published: (2025)

Reservoir Network with Structural Plasticity for Human Activity Recognition
by: Zyarah, Abdullah M., et al.
Published: (2025)

SCPL: Enhancing Neural Network Training Throughput with Decoupled Local Losses and Model Parallelism
by: Ho, Ming-Yao, et al.
Published: (2026)

Experience Replay Addresses Loss of Plasticity in Continual Learning
by: Wang, Jiuqi, et al.
Published: (2025)

A Simple Baseline for Stable and Plastic Neural Networks
by: Künzel, Étienne, et al.
Published: (2025)

Slow and Steady Wins the Race: Maintaining Plasticity with Hare and Tortoise Networks
by: Lee, Hojoon, et al.
Published: (2024)

Learning from Integral Losses in Physics Informed Neural Networks
by: Saleh, Ehsan, et al.
Published: (2023)

Temporal Decisions: Leveraging Temporal Correlation for Efficient Decisions in Early Exit Neural Networks
by: Sponner, Max, et al.
Published: (2024)

Meta-GCN: A Dynamically Weighted Loss Minimization Method for Dealing with the Data Imbalance in Graph Neural Networks
by: Mohammadizadeh, Mahdi, et al.
Published: (2024)

Teasing Apart Architecture and Initial Weights as Sources of Inductive Bias in Neural Networks
by: Bencomo, Gianluca, et al.
Published: (2025)

Meta-Learning Loss Functions for Deep Neural Networks
by: Raymond, Christian
Published: (2024)

DL101 Neural Network Outputs and Loss Functions
by: Berzal, Fernando
Published: (2025)

Preference-Based Alignment of Discrete Diffusion Models
by: Borso, Umberto, et al.
Published: (2025)

Plasticity as the Mirror of Empowerment
by: Abel, David, et al.
Published: (2025)

Barycentric Neural Networks and Length-Weighted Persistent Entropy Loss: A Green Geometric and Topological Framework for Function Approximation
by: Toscano-Duran, Victor, et al.
Published: (2025)

Sharpness-Aware Black-Box Optimization
by: Ye, Feiyang, et al.
Published: (2024)

Sharpness-Aware Teleportation on Riemannian Manifolds
by: Truong, Tuan, et al.
Published: (2023)

Stability Analysis of Sharpness-Aware Minimization
by: Kim, Hoki, et al.
Published: (2023)

Rethinking Plasticity in Deep Reinforcement Learning
by: He, Zhiqiang
Published: (2026)

Membership Privacy Risks of Sharpness Aware Minimization
by: Kim, Young In, et al.
Published: (2023)