Image de couverture de livre

Do Pre-trained Models Benefit Equally in Continual Learning?

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lee, Kuan-Ying, Zhong, Yuanyi, Wang, Yu-Xiong
Format:	Preprint
Publié:	2022
Sujets:	Computer Vision and Pattern Recognition Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning
par: Wang, Huiyi, et autres
Publié: (2024)

Realistic Continual Learning Approach using Pre-trained Models
par: Nasri, Nadia, et autres
Publié: (2024)

RanPAC: Random Projections and Pre-trained Models for Continual Learning
par: McDonnell, Mark D., et autres
Publié: (2023)

Is Pre-training Truly Better Than Meta-Learning?
par: Miranda, Brando, et autres
Publié: (2023)

STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized Alignment
par: Lee, Jaewoo, et autres
Publié: (2023)

How Vision-Language Tasks Benefit from Large Pre-trained Models: A Survey
par: Qi, Yayun, et autres
Publié: (2024)

OCT Data is All You Need: How Vision Transformers with and without Pre-training Benefit Imaging
par: Han, Zihao, et autres
Publié: (2025)

Practical Continual Forgetting for Pre-trained Vision Models
par: Zhao, Hongbo, et autres
Publié: (2025)

Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery
par: Liu, Mingxuan, et autres
Publié: (2023)

Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks
par: Ding, Yuhe, et autres
Publié: (2024)

D4C: Data-Free Quantization for Contrastive Language-Image Pre-training Models
par: Zhang, Wenlun, et autres
Publié: (2025)

Continual Learning with Pre-Trained Models: A Survey
par: Zhou, Da-Wei, et autres
Publié: (2024)

SLCA++: Unleash the Power of Sequential Fine-tuning for Continual Learning with Pre-training
par: Zhang, Gengwei, et autres
Publié: (2024)

VisionTS++: Cross-Modal Time Series Foundation Model with Continual Pre-trained Vision Backbones
par: Shen, Lefei, et autres
Publié: (2025)

Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model
par: Shi, Jiang-Xin, et autres
Publié: (2024)

Do Your Best and Get Enough Rest for Continual Learning
par: Kang, Hankyul, et autres
Publié: (2025)

Multi-instance Learning as Downstream Task of Self-Supervised Learning-based Pre-trained Model
par: Matsuishi, Koki, et autres
Publié: (2025)

TExplain: Explaining Learned Visual Features via Pre-trained (Frozen) Language Models
par: Taghanaki, Saeid Asgari, et autres
Publié: (2023)

Split Adaptation for Pre-trained Vision Transformers
par: Wang, Lixu, et autres
Publié: (2025)

Domain Guidance: A Simple Transfer Approach for a Pre-trained Diffusion Model
par: Zhong, Jincheng, et autres
Publié: (2025)

Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models
par: Ahrens, Kyra, et autres
Publié: (2023)

Pre-trained Visual Dynamics Representations for Efficient Policy Learning
par: Luo, Hao, et autres
Publié: (2024)

PILOT: A Pre-Trained Model-Based Continual Learning Toolbox
par: Sun, Hai-Long, et autres
Publié: (2023)

DPAdapter: Improving Differentially Private Deep Learning through Noise Tolerance Pre-training
par: Wang, Zihao, et autres
Publié: (2024)

Epistemic Uncertainty Quantification For Pre-trained Neural Network
par: Wang, Hanjing, et autres
Publié: (2024)

Slot-Guided Adaptation of Pre-trained Diffusion Models for Object-Centric Learning and Compositional Generation
par: Akan, Adil Kaan, et autres
Publié: (2025)

Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers
par: Wang, Lirui, et autres
Publié: (2024)

UNIFORM: Unifying Knowledge from Large-scale and Diverse Pre-trained Models
par: Wang, Yimu, et autres
Publié: (2025)

Resilient Contrastive Pre-training under Non-Stationary Drift
par: Yang, Xiaoyu, et autres
Publié: (2025)

Machine Unlearning on Pre-trained Models by Residual Feature Alignment Using LoRA
par: Qin, Laiqiao, et autres
Publié: (2024)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
par: Li, Linjie, et autres
Publié: (2026)

Incorporating Pre-trained Diffusion Models in Solving the Schrödinger Bridge Problem
par: Tang, Zhicong, et autres
Publié: (2025)

ModelGrow: Continual Text-to-Video Pre-training with Model Expansion and Language Understanding Enhancement
par: Rao, Zhefan, et autres
Publié: (2024)

SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models
par: Zhao, Linglan, et autres
Publié: (2024)

Understanding Flatness in Generative Models: Its Role and Benefits
par: Lee, Taehwan, et autres
Publié: (2025)

Feature Unlearning for Pre-trained GANs and VAEs
par: Moon, Saemi, et autres
Publié: (2023)

Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch
par: Cai, Xu, et autres
Publié: (2025)

Benchmarking Few-shot Transferability of Pre-trained Models with Improved Evaluation Protocols
par: Luo, Xu, et autres
Publié: (2026)

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation
par: Zhang, Yuhui, et autres
Publié: (2023)

Divide and not forget: Ensemble of selectively trained experts in Continual Learning
par: Rypeść, Grzegorz, et autres
Publié: (2024)