Cover Image

Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Thede, Lukas, Roth, Karsten, Hénaff, Olivier J., Bethge, Matthias, Akata, Zeynep
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
by: Roth, Karsten, et al.
Published: (2023)

Context-Aware Multimodal Pretraining
by: Roth, Karsten, et al.
Published: (2024)

A Practitioner's Guide to Continual Multimodal Pretraining
by: Roth, Karsten, et al.
Published: (2024)

ETHER: Efficient Finetuning of Large-Scale Models with Hyperplane Reflections
by: Bini, Massimo, et al.
Published: (2024)

How to Merge Your Multimodal Models Over Time?
by: Dziadzio, Sebastian, et al.
Published: (2024)

WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMs
by: Thede, Lukas, et al.
Published: (2025)

Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models
by: Singhi, Nishad, et al.
Published: (2024)

Disentangled Representation Learning with the Gromov-Monge Gap
by: Uscidda, Théo, et al.
Published: (2024)

Sparse Autoencoders are Topic Models
by: Girrbach, Leander, et al.
Published: (2025)

Rehearsal-free and Task-free Online Continual Learning With Contrastive Prompt
by: Wang, Aopeng, et al.
Published: (2025)

Investigating Structural Pruning and Recovery Techniques for Compressing Multimodal Large Language Models: An Empirical Study
by: Huang, Yiran, et al.
Published: (2025)

Rehearsal-free Federated Domain-incremental Learning
by: Sun, Rui, et al.
Published: (2024)

Consistent Prompting for Rehearsal-Free Continual Learning
by: Gao, Zhanxin, et al.
Published: (2024)

Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers
by: Roschmann, Simon, et al.
Published: (2025)

DeLoRA: Decoupling Angles and Strength in Low-rank Adaptation
by: Bini, Massimo, et al.
Published: (2025)

Vision-by-Language for Training-Free Compositional Image Retrieval
by: Karthik, Shyamgopal, et al.
Published: (2023)

Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Models
by: Eyring, Luca, et al.
Published: (2025)

From Drop-off to Recovery: A Mechanistic Analysis of Segmentation in MLLMs
by: Wu, Boyong, et al.
Published: (2026)

GRASP: A Rehearsal Policy for Efficient Online Continual Learning
by: Harun, Md Yousuf, et al.
Published: (2023)

Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
by: Pach, Mateusz, et al.
Published: (2025)

Beyond the final layer: Attentive multilayer fusion for vision transformers
by: Ciernik, Laure, et al.
Published: (2026)

ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization
by: Eyring, Luca, et al.
Published: (2024)

The Manifold Hypothesis for Gradient-Based Explanations
by: Bordt, Sebastian, et al.
Published: (2022)

Forget Less, Retain More: A Lightweight Regularizer for Rehearsal-Based Continual Learning
by: Alssum, Lama, et al.
Published: (2025)

Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning
by: Khan, Hikmat, et al.
Published: (2024)

Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models
by: Ahrens, Kyra, et al.
Published: (2023)

MosaicDiff: Training-free Structural Pruning for Diffusion Model Acceleration Reflecting Pretraining Dynamics
by: Guo, Bowei, et al.
Published: (2025)

REP: Resource-Efficient Prompting for Rehearsal-Free Continual Learning
by: Jeon, Sungho, et al.
Published: (2024)

Modeling Saliency Dataset Bias
by: Kümmerer, Matthias, et al.
Published: (2025)

RDumb: A simple approach that questions our progress in continual test-time adaptation
by: Press, Ori, et al.
Published: (2023)

Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization
by: Dziadzio, Sebastian, et al.
Published: (2023)

Concept-Aware Batch Sampling Improves Language-Image Pretraining
by: Ghosh, Adhiraj, et al.
Published: (2025)

No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance
by: Udandarao, Vishaal, et al.
Published: (2024)

DataDream: Few-shot Guided Dataset Generation
by: Kim, Jae Myung, et al.
Published: (2024)

SUB: Benchmarking CBM Generalization via Synthetic Attribute Substitutions
by: Bader, Jessica, et al.
Published: (2025)

Layerwise complexity-matched learning yields an improved model of cortical area V2
by: Parthasarathy, Nikhil, et al.
Published: (2023)

Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning
by: Tamajo, Alberto, et al.
Published: (2026)

PROL : Rehearsal Free Continual Learning in Streaming Data via Prompt Online Learning
by: Ma'sum, M. Anwar, et al.
Published: (2025)

Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models
by: Girrbach, Leander, et al.
Published: (2025)

Post-hoc Probabilistic Vision-Language Models
by: Baumann, Anton, et al.
Published: (2024)