Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.26297 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911630862843904 |
|---|---|
| author | Jiang, Douglas Wang, Yuechen Wang, Jiayi Geng, Jiaying Wang, Qinglong Tian, Feng |
| author_facet | Jiang, Douglas Wang, Yuechen Wang, Jiayi Geng, Jiaying Wang, Qinglong Tian, Feng |
| contents | Optimization algorithms are fundamental to modern deep learning, yet most widely used methods rely on update rules based primarily on local gradient statistics. We introduce NeuroPlastic, a plasticity-modulated optimizer that augments gradient-based updates with an adaptive multi-signal modulation mechanism inspired by multi-factor synaptic plasticity, a concept from neurobiology. NeuroPlastic dynamically scales gradient updates using interacting components that capture gradient, activity-like, and memory-like statistics, forming a lightweight modulation layer compatible with standard deep learning training pipelines. Across image classification benchmarks, NeuroPlastic consistently improves over a controlled gradient-only ablation, with more pronounced gains on the Fashion-MNIST benchmark and in reduced-data regimes. In transfer experiments on CIFAR-10 with ResNet-18, the method remains stable and competitive without retuning. These results suggest that multi-signal plasticity-inspired modulation can provide a useful extension to conventional gradient-driven optimization, particularly when learning signals are limited or noisy, and offer a promising direction for gradient-based methods in deep learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_26297 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | NeuroPlastic: A Plasticity-Modulated Optimizer for Biologically Inspired Learning Dynamics Jiang, Douglas Wang, Yuechen Wang, Jiayi Geng, Jiaying Wang, Qinglong Tian, Feng Machine Learning Optimization algorithms are fundamental to modern deep learning, yet most widely used methods rely on update rules based primarily on local gradient statistics. We introduce NeuroPlastic, a plasticity-modulated optimizer that augments gradient-based updates with an adaptive multi-signal modulation mechanism inspired by multi-factor synaptic plasticity, a concept from neurobiology. NeuroPlastic dynamically scales gradient updates using interacting components that capture gradient, activity-like, and memory-like statistics, forming a lightweight modulation layer compatible with standard deep learning training pipelines. Across image classification benchmarks, NeuroPlastic consistently improves over a controlled gradient-only ablation, with more pronounced gains on the Fashion-MNIST benchmark and in reduced-data regimes. In transfer experiments on CIFAR-10 with ResNet-18, the method remains stable and competitive without retuning. These results suggest that multi-signal plasticity-inspired modulation can provide a useful extension to conventional gradient-driven optimization, particularly when learning signals are limited or noisy, and offer a promising direction for gradient-based methods in deep learning. |
| title | NeuroPlastic: A Plasticity-Modulated Optimizer for Biologically Inspired Learning Dynamics |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2604.26297 |