Task Switching Without Forgetting via Proximal Decoupling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shamsolmoali, Pourya, Zareapoor, Masoumeh, Granger, Eric, Smith, William A. P., Lu, Yue
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914494206181376
author Shamsolmoali, Pourya
Zareapoor, Masoumeh
Granger, Eric
Smith, William A. P.
Lu, Yue
author_facet Shamsolmoali, Pourya
Zareapoor, Masoumeh
Granger, Eric
Smith, William A. P.
Lu, Yue
contents In continual learning, the primary challenge is to learn new information without forgetting old knowledge. A common solution addresses this trade-off through regularization, penalizing changes to parameters critical for previous tasks. In most cases, this regularization term is directly added to the training loss and optimized with standard gradient descent, which blends learning and retention signals into a single update and does not explicitly separate essential parameters from redundant ones. As task sequences grow, this coupling can over-constrain the model, limiting forward transfer and leading to inefficient use of capacity. We propose a different approach that separates task learning from stability enforcement via operator splitting. The learning step focuses on minimizing the current task loss, while a proximal stability step applies a sparse regularizer to prune unnecessary parameters and preserve task-relevant ones. This turns the stability-plasticity into a negotiated update between two complementary operators, rather than a conflicting gradient. We provide theoretical justification for the splitting method on the continual-learning objective, and demonstrate that our proposed solver achieves state-of-the-art results on standard benchmarks, improving both stability and adaptability without the need for replay buffers, Bayesian sampling, or meta-learning components.
format Preprint
id arxiv_https___arxiv_org_abs_2604_18857
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Task Switching Without Forgetting via Proximal Decoupling
Shamsolmoali, Pourya
Zareapoor, Masoumeh
Granger, Eric
Smith, William A. P.
Lu, Yue
Machine Learning
Computer Vision and Pattern Recognition
In continual learning, the primary challenge is to learn new information without forgetting old knowledge. A common solution addresses this trade-off through regularization, penalizing changes to parameters critical for previous tasks. In most cases, this regularization term is directly added to the training loss and optimized with standard gradient descent, which blends learning and retention signals into a single update and does not explicitly separate essential parameters from redundant ones. As task sequences grow, this coupling can over-constrain the model, limiting forward transfer and leading to inefficient use of capacity. We propose a different approach that separates task learning from stability enforcement via operator splitting. The learning step focuses on minimizing the current task loss, while a proximal stability step applies a sparse regularizer to prune unnecessary parameters and preserve task-relevant ones. This turns the stability-plasticity into a negotiated update between two complementary operators, rather than a conflicting gradient. We provide theoretical justification for the splitting method on the continual-learning objective, and demonstrate that our proposed solver achieves state-of-the-art results on standard benchmarks, improving both stability and adaptability without the need for replay buffers, Bayesian sampling, or meta-learning components.
title Task Switching Without Forgetting via Proximal Decoupling
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.18857