Cover Image

Activation Function Design Sustains Plasticity in Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lillo, Lute, Cheney, Nick
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Beyond Single-Model Optimization: Preserving Plasticity in Continual Reinforcement Learning
by: Lillo, Lute, et al.
Published: (2026)

On the Stability of Growth in Structural Plasticity
by: Lillo, Lute, et al.
Published: (2026)

Continual learning under domain transfer with sparse synaptic bursting
by: Beaulieu, Shawn L., et al.
Published: (2021)

How Weight Resampling and Optimizers Shape the Dynamics of Continual Learning and Forgetting in Neural Networks
by: Frati, Lapo, et al.
Published: (2025)

Activation Function Optimization Scheme for Image Classification
by: Rahman, Abdur, et al.
Published: (2024)

IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual Learning
by: Bhat, Prashant, et al.
Published: (2024)

RepAct: The Re-parameterizable Adaptive Activation Function
by: Wu, Xian, et al.
Published: (2024)

Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility
by: Erden, Zeki Doruk, et al.
Published: (2025)

Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning
by: Frati, Lapo, et al.
Published: (2023)

Open-World Continual Learning: Unifying Novelty Detection and Continual Learning
by: Kim, Gyuhak, et al.
Published: (2023)

RCR-AF: Enhancing Model Generalization via Rademacher Complexity Reduction Activation Function
by: Yu, Yunrui, et al.
Published: (2025)

Parabolic Continual Learning
by: Yang, Haoming, et al.
Published: (2025)

A Simple Baseline for Stable and Plastic Neural Networks
by: Künzel, Étienne, et al.
Published: (2025)

Learning with Preserving for Continual Multitask Learning
by: Wang, Hanchen David, et al.
Published: (2025)

Domain Generalizable Continual Learning
by: Yan, Hongwei, et al.
Published: (2025)

Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions
by: Baumann, Stefan Andreas, et al.
Published: (2024)

Extrapolation of Periodic Functions Using Binary Encoding of Continuous Numerical Values
by: Powell, Brian P., et al.
Published: (2025)

Learning without Isolation: Pathway Protection for Continual Learning
by: Chen, Zhikang, et al.
Published: (2025)

Learning Equi-angular Representations for Online Continual Learning
by: Seo, Minhyuk, et al.
Published: (2024)

On the Computation of the Fisher Information in Continual Learning
by: van de Ven, Gido M.
Published: (2025)

Scalable Strategies for Continual Learning with Replay
by: Hickok, Truman
Published: (2025)

Continual Hyperbolic Learning of Instances and Classes
by: Ayoughi, Melika, et al.
Published: (2025)

Soft-TransFormers for Continual Learning
by: Kang, Haeyong, et al.
Published: (2024)

Continual Learning: Applications and the Road Forward
by: Verwimp, Eli, et al.
Published: (2023)

Slowing Down Forgetting in Continual Learning
by: Janetzky, Pascal, et al.
Published: (2024)

Towards Cross-Domain Continual Learning
by: de Carvalho, Marcus, et al.
Published: (2024)

Natural Gradient Descent for Online Continual Learning
by: Khawand, Joe, et al.
Published: (2026)

Is Continual Learning Ready for Real-world Challenges?
by: Kontogianni, Theodora, et al.
Published: (2024)

Continual Adaptation of Vision Transformers for Federated Learning
by: Halbe, Shaunak, et al.
Published: (2023)

Continual Learning of Diffusion Models with Generative Distillation
by: Masip, Sergi, et al.
Published: (2023)

A Unified and General Framework for Continual Learning
by: Wang, Zhenyi, et al.
Published: (2024)

A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning
by: Wang, Zhenyi, et al.
Published: (2023)

STAR: Stability-Inducing Weight Perturbation for Continual Learning
by: Eskandar, Masih, et al.
Published: (2025)

Task-conditioned Ensemble of Expert Models for Continuous Learning
by: Sharma, Renu, et al.
Published: (2025)

Elastic Weight Consolidation Done Right for Continual Learning
by: Liu, Xuan, et al.
Published: (2026)

Memory-efficient Continual Learning with Neural Collapse Contrastive
by: Dang, Trung-Anh, et al.
Published: (2024)

IDER: IDempotent Experience Replay for Reliable Continual Learning
by: Liu, Zhanwang, et al.
Published: (2026)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

Activation Matters: Test-time Activated Negative Labels for OOD Detection with Vision-Language Models
by: Zhang, Yabin, et al.
Published: (2026)

PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online Learning
by: Ma'sum, M. Anwar, et al.
Published: (2025)