Schema Augmentation for Zero-Shot Domain Adaptation in Dialogue State Tracking
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913701885378560 |
|---|---|
| author | Richardson, Christopher Sharma, Roshan Gaur, Neeraj Haghani, Parisa Sundar, Anirudh Ramabhadran, Bhuvana |
| author_facet | Richardson, Christopher Sharma, Roshan Gaur, Neeraj Haghani, Parisa Sundar, Anirudh Ramabhadran, Bhuvana |
| contents | Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model approaches for zero-shot domain adaptation rely on prompting to introduce knowledge pertaining to the target domains. However, their efficacy strongly depends on prompt engineering, as well as the zero-shot ability of the underlying language model. In this work, we devise a novel data augmentation approach, Schema Augmentation, that improves the zero-shot domain adaptation of language models through fine-tuning. Schema Augmentation is a simple but effective technique that enhances generalization by introducing variations of slot names within the schema provided in the prompt. Experiments on MultiWOZ and SpokenWOZ showed that the proposed approach resulted in a substantial improvement over the baseline, in some experiments achieving over a twofold accuracy gain over unseen domains while maintaining equal or superior performance over all domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_00150 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Schema Augmentation for Zero-Shot Domain Adaptation in Dialogue State Tracking Richardson, Christopher Sharma, Roshan Gaur, Neeraj Haghani, Parisa Sundar, Anirudh Ramabhadran, Bhuvana Computation and Language Artificial Intelligence Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model approaches for zero-shot domain adaptation rely on prompting to introduce knowledge pertaining to the target domains. However, their efficacy strongly depends on prompt engineering, as well as the zero-shot ability of the underlying language model. In this work, we devise a novel data augmentation approach, Schema Augmentation, that improves the zero-shot domain adaptation of language models through fine-tuning. Schema Augmentation is a simple but effective technique that enhances generalization by introducing variations of slot names within the schema provided in the prompt. Experiments on MultiWOZ and SpokenWOZ showed that the proposed approach resulted in a substantial improvement over the baseline, in some experiments achieving over a twofold accuracy gain over unseen domains while maintaining equal or superior performance over all domains. |
| title | Schema Augmentation for Zero-Shot Domain Adaptation in Dialogue State Tracking |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2411.00150 |