Cover Image

The Importance of Being Lazy: Scaling Limits of Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Graldi, Jacopo, Breccia, Alessandro, Lanzillotta, Giulia, Hofmann, Thomas, Noci, Lorenzo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Heads collapse, features stay: Why Replay needs big buffers
by: Lanzillotta, Giulia, et al.
Published: (2025)

Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
by: Lanzillotta, Giulia, et al.
Published: (2025)

Local vs Global continual learning
by: Lanzillotta, Giulia, et al.
Published: (2024)

LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers
by: Shen, Xuan, et al.
Published: (2024)

Barriers for Learning in an Evolving World: Mathematical Understanding of Loss of Plasticity
by: Joudaki, Amir, et al.
Published: (2025)

Reactivation: Empirical NTK Dynamics Under Task Shifts
by: Liu, Yuzhi, et al.
Published: (2025)

Lazy But Effective: Collaborative Personalized Federated Learning with Heterogeneous Data
by: Rokvic, Ljubomir, et al.
Published: (2025)

Parameter Importance-Driven Continual Learning for Foundation Models
by: Wang, Lingxiang, et al.
Published: (2025)

Laziness, Barren Plateau, and Noise in Machine Learning
by: Liu, Junyu, et al.
Published: (2022)

Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes
by: Tu, Zhenfeng, et al.
Published: (2024)

Trust and Resilience in Federated Learning Through Smart Contracts Enabled Decentralized Systems
by: Cassano, Lorenzo, et al.
Published: (2024)

Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolants
by: Damsholt, Gabriel, et al.
Published: (2026)

Closed-form merging of parameter-efficient modules for Federated Continual Learning
by: Salami, Riccardo, et al.
Published: (2024)

LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
by: Fu, Qichen, et al.
Published: (2024)

Don't be lazy: CompleteP enables compute-efficient deep transformers
by: Dey, Nolan, et al.
Published: (2025)

Temporal-Difference Variational Continual Learning
by: Melo, Luckeciano C., et al.
Published: (2024)

ContinualFlow: Learning and Unlearning with Neural Flow Matching
by: Simone, Lorenzo, et al.
Published: (2025)

ORLA*: Mobile Manipulator-Based Object Rearrangement with Lazy A Star
by: Gao, Kai, et al.
Published: (2023)

Diffmv: A Unified Diffusion Framework for Healthcare Predictions with Random Missing Views and View Laziness
by: Zhao, Chuang, et al.
Published: (2025)

SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs
by: Mozaffari, Mohammad, et al.
Published: (2024)

Learning to Play 7 Wonders Duel Without Human Supervision
by: Paolini, Giovanni, et al.
Published: (2024)

LIA: Privacy-Preserving Data Quality Evaluation in Federated Learning Using a Lazy Influence Approximation
by: Rokvic, Ljubomir, et al.
Published: (2022)

Gated Adaptation for Continual Learning in Human Activity Recognition
by: Azghan, Reza Rahimi, et al.
Published: (2026)

Super Consistency of Neural Network Landscapes and Learning Rate Transfer
by: Noci, Lorenzo, et al.
Published: (2024)

The Limits of Inference Scaling Through Resampling
by: Stroebl, Benedikt, et al.
Published: (2024)

The Importance of Architecture Choice in Deep Learning for Climate Applications
by: Dräger, Simon, et al.
Published: (2024)

A Short Survey on Importance Weighting for Machine Learning
by: Kimura, Masanari, et al.
Published: (2024)

Explainability and Continual Learning meet Federated Learning at the Network Edge
by: Tsouparopoulos, Thomas, et al.
Published: (2025)

Low Variance Off-policy Evaluation with State-based Importance Sampling
by: Bossens, David M., et al.
Published: (2022)

On the Limitations of Markovian Rewards to Express Multi-Objective, Risk-Sensitive, and Modal Tasks
by: Skalse, Joar, et al.
Published: (2024)

On the Emergence of Induction Heads for In-Context Learning
by: Musat, Tiberiu, et al.
Published: (2025)

Inverse Depth Scaling From Most Layers Being Similar
by: Liu, Yizhou, et al.
Published: (2026)

Continual Learning in the Presence of Repetition
by: Hemati, Hamed, et al.
Published: (2024)

Evaluating Machine Learning Models against Clinical Protocols for Enhanced Interpretability and Continuity of Care
by: Sirocchi, Christel, et al.
Published: (2024)

Step-size Optimization for Continual Learning
by: Degris, Thomas, et al.
Published: (2024)

Transformer Fusion with Optimal Transport
by: Imfeld, Moritz, et al.
Published: (2023)

Trading-off Accuracy and Communication Cost in Federated Learning
by: Villani, Mattia Jacopo, et al.
Published: (2025)

A Machine Learning Pipeline for Multiple Sclerosis Biomarker Discovery: Comparing explainable AI and Traditional Statistical Approaches
by: Punzo, Samuele, et al.
Published: (2025)

Retrofit: Continual Learning with Controlled Forgetting for Binary Security Detection and Analysis
by: He, Yiling, et al.
Published: (2025)

Importance Sampling for Nonlinear Models
by: Rajmohan, Prakash Palanivelu, et al.
Published: (2025)