Slumbering to Precision: Enhancing Artificial Neural Network Calibration Through Sleep-like Processes
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911498507386880 |
|---|---|
| author | Delanois, Jean Erik Ahuja, Aditya Krishnan, Giri P. Bazhenov, Maxim |
| author_facet | Delanois, Jean Erik Ahuja, Aditya Krishnan, Giri P. Bazhenov, Maxim |
| contents | Artificial neural networks are often overconfident, undermining trust because their predicted probabilities do not match actual accuracy. Inspired by biological sleep and the role of spontaneous replay in memory and learning, we introduce Sleep Replay Consolidation (SRC), a novel calibration approach. SRC is a post-training, sleep-like phase that selectively replays internal representations to update network weights and improve calibration without supervised retraining. Across multiple experiments, SRC is competitive with and complementary to standard approaches such as temperature scaling. Combining SRC with temperature scaling achieves the best Brier score and entropy trade-offs for AlexNet and VGG19. These results show that SRC provides a fundamentally novel approach to improving neural network calibration. SRC-based calibration offers a practical path toward more trustworthy confidence estimates and narrows the gap between human-like uncertainty handling and modern deep networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_07867 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Slumbering to Precision: Enhancing Artificial Neural Network Calibration Through Sleep-like Processes Delanois, Jean Erik Ahuja, Aditya Krishnan, Giri P. Bazhenov, Maxim Machine Learning Artificial Intelligence Artificial neural networks are often overconfident, undermining trust because their predicted probabilities do not match actual accuracy. Inspired by biological sleep and the role of spontaneous replay in memory and learning, we introduce Sleep Replay Consolidation (SRC), a novel calibration approach. SRC is a post-training, sleep-like phase that selectively replays internal representations to update network weights and improve calibration without supervised retraining. Across multiple experiments, SRC is competitive with and complementary to standard approaches such as temperature scaling. Combining SRC with temperature scaling achieves the best Brier score and entropy trade-offs for AlexNet and VGG19. These results show that SRC provides a fundamentally novel approach to improving neural network calibration. SRC-based calibration offers a practical path toward more trustworthy confidence estimates and narrows the gap between human-like uncertainty handling and modern deep networks. |
| title | Slumbering to Precision: Enhancing Artificial Neural Network Calibration Through Sleep-like Processes |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2603.07867 |