Cover Image

Understanding Forgetting in Continual Learning with Linear Regression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ding, Meng, Ji, Kaiyi, Wang, Di, Xu, Jinhui
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Provable Effects of Data Replay in Continual Learning: A Feature Learning Perspective
by: Ding, Meng, et al.
Published: (2026)

Understanding Fine-tuning in Approximate Unlearning: A Theoretical Perspective
by: Ding, Meng, et al.
Published: (2024)

Turning Back Without Forgetting: Selective Backward Refinement for Parameter-Efficient Continual Learning
by: Tiwari, Anushka, et al.
Published: (2026)

Understanding Generalization and Forgetting in In-Context Continual Learning
by: Li, Guangyu, et al.
Published: (2026)

Understanding Private Learning From Feature Perspective
by: Ding, Meng, et al.
Published: (2025)

Nearly Optimal Differentially Private ReLU Regression
by: Ding, Meng, et al.
Published: (2025)

Online Forgetting Process for Linear Regression Models
by: Li, Yuantong, et al.
Published: (2020)

Differentially Private Sparse Linear Regression with Heavy-tailed Responses
by: Tian, Xizhi, et al.
Published: (2025)

Beyond Ordinary Lipschitz Constraints: Differentially Private Stochastic Optimization with Tsybakov Noise Condition
by: Xu, Difei, et al.
Published: (2025)

Fair Resource Allocation in Multi-Task Learning
by: Ban, Hao, et al.
Published: (2024)

Lower Complexity Bounds for Nonconvex-Strongly-Convex Bilevel Optimization with First-Order Oracles
by: Ji, Kaiyi
Published: (2025)

GRID: Scalable Task-Agnostic Prompt-Based Continual Learning for Language Models
by: Tiwari, Anushka, et al.
Published: (2025)

Improved Rates of Differentially Private Nonconvex-Strongly-Concave Minimax Optimization
by: Zhang, Ruijia, et al.
Published: (2025)

MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL
by: Pang, Jinhui, et al.
Published: (2025)

Forget Forgetting: Continual Learning in a World of Abundant Memory
by: Cho, Dongkyu, et al.
Published: (2025)

Spurious Forgetting in Continual Learning of Language Models
by: Zheng, Junhao, et al.
Published: (2025)

No Forgetting Learning: Buffer-free Continual Learning Classification
by: Vahedifar, Mohammad Ali, et al.
Published: (2025)

A Tutorial on Regression Analysis: From Linear Models to Deep Learning -- Lecture Notes on Artificial Intelligence
by: Wang, Jingyuan, et al.
Published: (2025)

Towards User-level Private Reinforcement Learning with Human Feedback
by: Zhang, Jiaming, et al.
Published: (2025)

Meta-Learning with Heterogeneous Tasks
by: Si, Zhaofeng, et al.
Published: (2024)

Data-dependent and Oracle Bounds on Forgetting in Continual Learning
by: Friedman, Lior, et al.
Published: (2024)

From Order to Distribution: A Spectral Characterization of Forgetting in Continual Learning
by: Xu, Zonghuan, et al.
Published: (2026)

Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning
by: Wang, Xinrui, et al.
Published: (2024)

A Forget-and-Grow Strategy for Deep Reinforcement Learning Scaling in Continuous Control
by: Kang, Zilin, et al.
Published: (2025)

Overcoming Catastrophic Forgetting in Visual Continual Learning with Reinforcement Fine-Tuning
by: Lou, Meng, et al.
Published: (2026)

Theoretical Study of Conflict-Avoidant Multi-Objective Reinforcement Learning
by: Wang, Yudan, et al.
Published: (2024)

LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control
by: Xiao, Peiyao, et al.
Published: (2025)

DeepMTL2R: A Library for Deep Multi-task Learning to Rank
by: Dong, Chaosheng, et al.
Published: (2026)

Sequencing to Mitigate Catastrophic Forgetting in Continual Learning
by: Moussa, Hesham G., et al.
Published: (2025)

Accurate Forgetting for Heterogeneous Federated Continual Learning
by: Wuerkaixi, Abudukelimu, et al.
Published: (2025)

Continual Learning with Strategic Selection and Forgetting for Network Intrusion Detection
by: Zhang, Xinchen, et al.
Published: (2024)

Optimal Rates in Continual Linear Regression via Increasing Regularization
by: Levinstein, Ran, et al.
Published: (2025)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
by: Ban, Hao, et al.
Published: (2025)

Learning to Forget: Continual Learning with Adaptive Weight Decay
by: Ramesh, Aditya A., et al.
Published: (2026)

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning
by: Elsayed, Mohamed, et al.
Published: (2024)

Mitigating Forgetting in Continual Learning with Selective Gradient Projection
by: Singh, Anika, et al.
Published: (2026)

On the Implicit Adversariality of Catastrophic Forgetting in Deep Continual Learning
by: Peng, Ze, et al.
Published: (2025)

Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability
by: Masip, Sergi, et al.
Published: (2026)

Exploring the Impact of Parameter Update Magnitude on Forgetting and Generalization of Continual Learning
by: He, JinLi, et al.
Published: (2026)

Understanding and Improving Continuous Adversarial Training for LLMs via In-context Learning Theory
by: Fu, Shaopeng, et al.
Published: (2026)