Imagen de Portada

Towards a General Framework for Continual Learning with Pre-training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Liyuan, Xie, Jingyi, Zhang, Xingxing, Su, Hang, Zhu, Jun
Formato:	Preprint
Publicado:	2023
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning
por: Wang, Liyuan, et al.
Publicado: (2024)

A Comprehensive Survey of Continual Learning: Theory, Method and Application
por: Wang, Liyuan, et al.
Publicado: (2023)

PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning
por: Ying, Chengyang, et al.
Publicado: (2024)

Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection
por: Sun, Guanglong, et al.
Publicado: (2026)

SLCA++: Unleash the Power of Sequential Fine-tuning for Continual Learning with Pre-training
por: Zhang, Gengwei, et al.
Publicado: (2024)

Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
por: Lei, Yu, et al.
Publicado: (2025)

S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training
por: Hu, Yuezhou, et al.
Publicado: (2024)

CLDyB: Towards Dynamic Benchmarking for Continual Learning with Pre-trained Models
por: Chen, Shengzhuang, et al.
Publicado: (2025)

Caption, Create, Continue: Continual Learning with Pre-trained Generative Vision-Language Models
por: Solomon, Indu, et al.
Publicado: (2024)

Fourier Controller Networks for Real-Time Decision-Making in Embodied Learning
por: Tan, Hengkai, et al.
Publicado: (2024)

ManiBox: Enhancing Embodied Spatial Generalization via Scalable Simulation Data Generations
por: Tan, Hengkai, et al.
Publicado: (2024)

Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control
por: Chen, Huayu, et al.
Publicado: (2024)

WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communication
por: Yang, Tingting, et al.
Publicado: (2025)

Towards Pre-trained Graph Condensation via Optimal Transport
por: Yan, Yeyu, et al.
Publicado: (2025)

MUON+: Towards More Effective Muon via One Additional Normalization Step for LLM Pre-training
por: Zhang, Ruijie, et al.
Publicado: (2026)

PACE: Pretrained Audio Continual Learning
por: Li, Chang, et al.
Publicado: (2026)

Continual-NExT: A Unified Comprehension And Generation Continual Learning Framework
por: Qiao, Jingyang, et al.
Publicado: (2026)

Practical Continual Forgetting for Pre-trained Vision Models
por: Zhao, Hongbo, et al.
Publicado: (2025)

On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code
por: Weyssow, Martin, et al.
Publicado: (2023)

Do Pre-trained Models Benefit Equally in Continual Learning?
por: Lee, Kuan-Ying, et al.
Publicado: (2022)

Accelerating Transformer Pre-training with 2:4 Sparsity
por: Hu, Yuezhou, et al.
Publicado: (2024)

On the Blessing of Pre-training in Weak-to-Strong Generalization
por: Yao, Wei, et al.
Publicado: (2026)

Towards the Worst-case Robustness of Large Language Models
por: Chen, Huanran, et al.
Publicado: (2025)

NetMamba+: A Framework of Pre-trained Models for Efficient and Accurate Network Traffic Classification
por: Wang, Tongze, et al.
Publicado: (2026)

Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning
por: Wang, Huiyi, et al.
Publicado: (2024)

Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment
por: Chen, Huayu, et al.
Publicado: (2024)

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
por: Singh, Vaibhav, et al.
Publicado: (2025)

Bidirectional Generative Pre-training for Improving Healthcare Time-series Representation Learning
por: Song, Ziyang, et al.
Publicado: (2024)

Towards Safe Reinforcement Learning via Constraining Conditional Value-at-Risk
por: Ying, Chengyang, et al.
Publicado: (2022)

C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
por: Zhang, Xin, et al.
Publicado: (2025)

Transfer Learning with Pre-trained Conditional Generative Models
por: Yamaguchi, Shin'ya, et al.
Publicado: (2022)

Realistic Continual Learning Approach using Pre-trained Models
por: Nasri, Nadia, et al.
Publicado: (2024)

Graph Generative Pre-trained Transformer
por: Chen, Xiaohui, et al.
Publicado: (2025)

Timer: Generative Pre-trained Transformers Are Large Time Series Models
por: Liu, Yong, et al.
Publicado: (2024)

Task Aware Dreamer for Task Generalization in Reinforcement Learning
por: Ying, Chengyang, et al.
Publicado: (2023)

MIPS: a Multimodal Infinite Polymer Sequence Pre-training Framework for Polymer Property Prediction
por: Wang, Jiaxi, et al.
Publicado: (2025)

RelPrism: A Multi-Faceted Pre-training Framework with Self-Generated Tasks for Relational Databases
por: Yang, Jinyu, et al.
Publicado: (2026)

An Efficient Replay for Class-Incremental Learning with Pre-trained Models
por: Yin, Weimin, et al.
Publicado: (2024)

Continual Learning with Pre-Trained Models: A Survey
por: Zhou, Da-Wei, et al.
Publicado: (2024)

GraphControl: Adding Conditional Control to Universal Graph Pre-trained Models for Graph Domain Transfer Learning
por: Zhu, Yun, et al.
Publicado: (2023)