Cover Image

Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Banayeeanzade, Amin, Soltanolkotabi, Mahdi, Rostami, Mohammad
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hybrid Learners Do Not Forget: A Brain-Inspired Neuro-Symbolic Approach to Continual Learning
by: Banayeeanzade, Amin, et al.
Published: (2025)

Continuous Unsupervised Domain Adaptation Using Stabilized Representations and Experience Replay
by: Rostami, Mohammad
Published: (2024)

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
by: Collins, Liam, et al.
Published: (2023)

Asymmetric Prompt Weighting for Reinforcement Learning with Verifiable Rewards
by: Heckel, Reinhard, et al.
Published: (2026)

Serpent: Scalable and Efficient Image Restoration via Multi-scale Structured State Space Models
by: Sepehri, Mohammad Shahab, et al.
Published: (2024)

GABRIL: Gaze-Based Regularization for Mitigating Causal Confusion in Imitation Learning
by: Banayeeanzade, Amin, et al.
Published: (2025)

Theoretical Limitations of Ensembles in the Age of Overparameterization
by: Dern, Niclas, et al.
Published: (2024)

Information-Theoretic Generalization Bounds of Replay-based Continual Learning
by: Wen, Wen, et al.
Published: (2025)

Training Dynamics of Softmax Self-Attention: Fast Global Convergence via Preconditioning
by: Goel, Gautam, et al.
Published: (2026)

Replay-Based Continual Learning for Physics-Informed Neural Operators
by: Wang, Yizheng, et al.
Published: (2026)

MosaicMRI: A Diverse Dataset and Benchmark for Raw Musculoskeletal MRI
by: Arguello, Paula, et al.
Published: (2026)

Learning to Recall with Transformers Beyond Orthogonal Embeddings
by: Vural, Nuri Mert, et al.
Published: (2026)

Multi-modal Synthetic Data Training and Model Collapse: Insights from VLMs and Diffusion Models
by: Hu, Zizhao, et al.
Published: (2025)

Analysis of Overparameterization in Continual Learning under a Linear Model
by: Goldfarb, Daniel, et al.
Published: (2025)

CryptoMamba: Leveraging State Space Models for Accurate Bitcoin Price Prediction
by: Sepehri, Mohammad Shahab, et al.
Published: (2025)

Task Shift: From Classification to Regression in Overparameterized Linear Models
by: LaBonte, Tyler, et al.
Published: (2025)

Operator-Based Generalization Bound for Deep Learning: Insights on Multi-Task Learning
by: Mohammadigohari, Mahdi, et al.
Published: (2025)

Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection
by: Cha, Seohyeon, et al.
Published: (2025)

The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model
by: Goldfarb, Daniel, et al.
Published: (2024)

Adapt and Diffuse: Sample-adaptive Reconstruction via Latent Diffusion Models
by: Fabian, Zalan, et al.
Published: (2023)

Language Generation with Replay: A Learning-Theoretic View of Model Collapse
by: Racca, Giorgio, et al.
Published: (2026)

Full-Batch Gradient Descent Outperforms One-Pass SGD: Sample Complexity Separation in Single-Index Learning
by: Kovačević, Filip, et al.
Published: (2026)

ATHENA: Adaptive Test-Time Steering for Improving Count Fidelity in Diffusion Models
by: Sepehri, Mohammad Shahab, et al.
Published: (2026)

An Analytical Model for Overparameterized Learning Under Class Imbalance
by: Mor, Eliav, et al.
Published: (2025)

Emergence and Evolution of Interpretable Concepts in Diffusion Models
by: Tinaz, Berk, et al.
Published: (2025)

Teaching AI to Remember: Insights from Brain-Inspired Replay in Continual Learning
by: Kim, Jina
Published: (2025)

On the Limitation and Experience Replay for GNNs in Continual Learning
by: Su, Junwei, et al.
Published: (2023)

Meta-Task: A Method-Agnostic Framework for Learning to Regularize in Few-Shot Learning
by: Rostami, Mohammad, et al.
Published: (2024)

The Interpolating Information Criterion for Overparameterized Models
by: Hodgkinson, Liam, et al.
Published: (2023)

ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
by: Gan, Haosheng, et al.
Published: (2025)

The Role of Symmetry in Optimizing Overparameterized Networks
by: Sareen, Kusha, et al.
Published: (2026)

The Rich and the Simple: On the Implicit Bias of Adam and SGD
by: Vasudeva, Bhavya, et al.
Published: (2025)

CRISPR: Ensemble Model
by: Rostami, Mohammad, et al.
Published: (2024)

Real-Time Stress Detection via Photoplethysmogram Signals: Implementation of a Combined Continuous Wavelet Transform and Convolutional Neural Network on Resource-Constrained Microcontrollers
by: Hasanpoor, Yasin, et al.
Published: (2024)

Graph Continual Learning with Debiased Lossless Memory Replay
by: Niu, Chaoxi, et al.
Published: (2024)

Unsupervised Replay Strategies for Continual Learning with Limited Data
by: Bazhenov, Anthony, et al.
Published: (2024)

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay
by: Rezaei, Hossein, et al.
Published: (2024)

Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem
by: Mohammadi, Hesameddin, et al.
Published: (2024)

Prototype-Based Continual Learning with Label-free Replay Buffer and Cluster Preservation Loss
by: Aghasanli, Agil, et al.
Published: (2025)

Better Generative Replay for Continual Federated Learning
by: Qi, Daiqing, et al.
Published: (2023)