Cover Image

How Weight Resampling and Optimizers Shape the Dynamics of Continual Learning and Forgetting in Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Frati, Lapo, Traft, Neil, Clune, Jeff, Cheney, Nick
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning
by: Frati, Lapo, et al.
Published: (2023)

Continual learning under domain transfer with sparse synaptic bursting
by: Beaulieu, Shawn L., et al.
Published: (2021)

Activation Function Design Sustains Plasticity in Continual Learning
by: Lillo, Lute, et al.
Published: (2025)

Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis
by: Kumar, Akarsh, et al.
Published: (2025)

More Than Memory Savings: Zeroth-Order Optimization Mitigates Forgetting in Continual Learning
by: Yu, Wanhao, et al.
Published: (2025)

Preventing Catastrophic Forgetting through Memory Networks in Continuous Detection
by: Bhatt, Gaurav, et al.
Published: (2024)

Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
by: Liu, Yuyang, et al.
Published: (2025)

Continual Learning of Achieving Forgetting-free and Positive Knowledge Transfer
by: Wang, Zhi, et al.
Published: (2026)

Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting
by: Hess, Timm, et al.
Published: (2023)

Overcoming Catastrophic Forgetting in Visual Continual Learning with Reinforcement Fine-Tuning
by: Lou, Meng, et al.
Published: (2026)

Slowing Down Forgetting in Continual Learning
by: Janetzky, Pascal, et al.
Published: (2024)

Shape Generation via Weight Space Learning
by: Plattner, Maximilian, et al.
Published: (2025)

Correcting Diffusion Generation through Resampling
by: Liu, Yujian, et al.
Published: (2023)

Forget Less, Retain More: A Lightweight Regularizer for Rehearsal-Based Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay
by: Rezaei, Hossein, et al.
Published: (2024)

Revisiting Neural Networks for Continual Learning: An Architectural Perspective
by: Lu, Aojun, et al.
Published: (2024)

Robust Continual Unlearning against Knowledge Erosion and Forgetting Reversal
by: Park, Eun-Ju, et al.
Published: (2026)

Learning to Learn without Forgetting using Attention
by: Vettoruzzo, Anna, et al.
Published: (2024)

Continual Learning and Catastrophic Forgetting
by: van de Ven, Gido M., et al.
Published: (2024)

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning
by: Liang, Jinglin, et al.
Published: (2024)

Learning from Oblivion: Predicting Knowledge Overflowed Weights via Retrodiction of Forgetting
by: Jang, Jinhyeok, et al.
Published: (2025)

A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
by: Wang, Zhenyi, et al.
Published: (2023)

Continual Learning: Forget-free Winning Subnetworks for Video Representations
by: Kang, Haeyong, et al.
Published: (2023)

Continuous Subspace Optimization for Continual Learning
by: Cheng, Quan, et al.
Published: (2025)

Learning without Forgetting for Vision-Language Models
by: Zhou, Da-Wei, et al.
Published: (2023)

ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation
by: Guo, Zirun, et al.
Published: (2025)

How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model
by: Cagnetta, Francesco, et al.
Published: (2023)

Forget Less by Learning Together through Concept Consolidation
by: Kaushik, Arjun Ramesh, et al.
Published: (2026)

Catastrophic Forgetting Mitigation via Discrepancy-Weighted Experience Replay
by: Xu, Xinrun, et al.
Published: (2025)

Your Image is Secretly the Last Frame of a Pseudo Video
by: Chen, Wenlong, et al.
Published: (2024)

Train Once, Forget Precisely: Anchored Optimization for Efficient Post-Hoc Unlearning
by: Sanga, Prabhav, et al.
Published: (2025)

FlexTok: Resampling Images into 1D Token Sequences of Flexible Length
by: Bachmann, Roman, et al.
Published: (2025)

Optimizing Convolutional Neural Network Architecture
by: Balderas, Luis, et al.
Published: (2023)

Forget Many, Forget Right: Scalable and Precise Concept Unlearning in Diffusion Models
by: Deng, Kaiyuan, et al.
Published: (2026)

Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning
by: Tamajo, Alberto, et al.
Published: (2026)

Forget Less by Learning from Parents Through Hierarchical Relationships
by: Kaushik, Arjun Ramesh, et al.
Published: (2026)

Practical Continual Forgetting for Pre-trained Vision Models
by: Zhao, Hongbo, et al.
Published: (2025)

Revised Regularization for Efficient Continual Learning through Correlation-Based Parameter Update in Bayesian Neural Networks
by: Palit, Sanchar, et al.
Published: (2024)

A Good Start Matters: Enhancing Continual Learning with Data-Driven Weight Initialization
by: Harun, Md Yousuf, et al.
Published: (2025)

Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Models
by: Gu, Jeffrey, et al.
Published: (2025)