Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.04864 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910051307880448 |
|---|---|
| author | Luo, Haihua Ran, Xuming Li, Zhengji Xue, Huiyan Jiang, Tingting Shen, Jiangrong Kärkkäinen, Tommi Xu, Qi Cong, Fengyu |
| author_facet | Luo, Haihua Ran, Xuming Li, Zhengji Xue, Huiyan Jiang, Tingting Shen, Jiangrong Kärkkäinen, Tommi Xu, Qi Cong, Fengyu |
| contents | Continual learning aims to enable models to acquire new knowledge while retaining previously learned information. Prompt-based methods have shown remarkable performance in this domain; however, they typically rely on key-value pairing, which can introduce inter-task interference and hinder scalability. To overcome these limitations, we propose a novel approach employing task-specific Prompt-Prototype (ProP), thereby eliminating the need for key-value pairs. In our method, task-specific prompts facilitate more effective feature learning for the current task, while corresponding prototypes capture the representative features of the input. During inference, predictions are generated by binding each task-specific prompt with its associated prototype. Additionally, we introduce regularization constraints during prompt initialization to penalize excessively large values, thereby enhancing stability. Experiments on several widely used datasets demonstrate the effectiveness of the proposed method. In contrast to mainstream prompt-based approaches, our framework removes the dependency on key-value pairs, offering a fresh perspective for future continual learning research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_04864 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Key-Value Pair-Free Continual Learner via Task-Specific Prompt-Prototype Luo, Haihua Ran, Xuming Li, Zhengji Xue, Huiyan Jiang, Tingting Shen, Jiangrong Kärkkäinen, Tommi Xu, Qi Cong, Fengyu Artificial Intelligence Continual learning aims to enable models to acquire new knowledge while retaining previously learned information. Prompt-based methods have shown remarkable performance in this domain; however, they typically rely on key-value pairing, which can introduce inter-task interference and hinder scalability. To overcome these limitations, we propose a novel approach employing task-specific Prompt-Prototype (ProP), thereby eliminating the need for key-value pairs. In our method, task-specific prompts facilitate more effective feature learning for the current task, while corresponding prototypes capture the representative features of the input. During inference, predictions are generated by binding each task-specific prompt with its associated prototype. Additionally, we introduce regularization constraints during prompt initialization to penalize excessively large values, thereby enhancing stability. Experiments on several widely used datasets demonstrate the effectiveness of the proposed method. In contrast to mainstream prompt-based approaches, our framework removes the dependency on key-value pairs, offering a fresh perspective for future continual learning research. |
| title | Key-Value Pair-Free Continual Learner via Task-Specific Prompt-Prototype |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2601.04864 |