Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.10992 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917669885706240 |
|---|---|
| author | Chen, Chen Li, Ruizhe Hu, Yuchen Chen, Yuanyuan Qin, Chengwei Zhang, Qiang |
| author_facet | Chen, Chen Li, Ruizhe Hu, Yuchen Chen, Yuanyuan Qin, Chengwei Zhang, Qiang |
| contents | Intelligent task-oriented dialogue systems (ToDs) are expected to continuously acquire new knowledge, also known as Continual Learning (CL), which is crucial to fit ever-changing user needs. However, catastrophic forgetting dramatically degrades the model performance in face of a long streamed curriculum. In this paper, we aim to overcome the forgetting problem in ToDs and propose a method (HESIT) with hyper-gradient-based exemplar strategy, which samples influential exemplars for periodic retraining. Instead of unilaterally observing data or models, HESIT adopts a profound exemplar selection strategy that considers the general performance of the trained model when selecting exemplars for each task domain. Specifically, HESIT analyzes the training data influence by tracing their hyper-gradient in the optimization process. Furthermore, HESIT avoids estimating Hessian to make it compatible for ToDs with a large pre-trained model. Experimental results show that HESIT effectively alleviates catastrophic forgetting by exemplar selection, and achieves state-of-the-art performance on the largest CL benchmark of ToDs in terms of all metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_10992 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen, Chen Li, Ruizhe Hu, Yuchen Chen, Yuanyuan Qin, Chengwei Zhang, Qiang Machine Learning Artificial Intelligence Intelligent task-oriented dialogue systems (ToDs) are expected to continuously acquire new knowledge, also known as Continual Learning (CL), which is crucial to fit ever-changing user needs. However, catastrophic forgetting dramatically degrades the model performance in face of a long streamed curriculum. In this paper, we aim to overcome the forgetting problem in ToDs and propose a method (HESIT) with hyper-gradient-based exemplar strategy, which samples influential exemplars for periodic retraining. Instead of unilaterally observing data or models, HESIT adopts a profound exemplar selection strategy that considers the general performance of the trained model when selecting exemplars for each task domain. Specifically, HESIT analyzes the training data influence by tracing their hyper-gradient in the optimization process. Furthermore, HESIT avoids estimating Hessian to make it compatible for ToDs with a large pre-trained model. Experimental results show that HESIT effectively alleviates catastrophic forgetting by exemplar selection, and achieves state-of-the-art performance on the largest CL benchmark of ToDs in terms of all metrics. |
| title | Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2405.10992 |