Intent-driven In-context Learning for Few-shot Dialogue State Tracking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yi, Zihao, Xu, Zhe, Shen, Ying
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915047993769984
author Yi, Zihao
Xu, Zhe
Shen, Ying
author_facet Yi, Zihao
Xu, Zhe
Shen, Ying
contents Dialogue state tracking (DST) plays an essential role in task-oriented dialogue systems. However, user's input may contain implicit information, posing significant challenges for DST tasks. Additionally, DST data includes complex information, which not only contains a large amount of noise unrelated to the current turn, but also makes constructing DST datasets expensive. To address these challenges, we introduce Intent-driven In-context Learning for Few-shot DST (IDIC-DST). By extracting user's intent, we propose an Intent-driven Dialogue Information Augmentation module to augment the dialogue information, which can track dialogue states more effectively. Moreover, we mask noisy information from DST data and rewrite user's input in the Intent-driven Examples Retrieval module, where we retrieve similar examples. We then utilize a pre-trained large language model to update the dialogue state using the augmented dialogue information and examples. Experimental results demonstrate that IDIC-DST achieves state-of-the-art performance in few-shot settings on MultiWOZ 2.1 and MultiWOZ 2.4 datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2412_03270
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Intent-driven In-context Learning for Few-shot Dialogue State Tracking
Yi, Zihao
Xu, Zhe
Shen, Ying
Computation and Language
Artificial Intelligence
Dialogue state tracking (DST) plays an essential role in task-oriented dialogue systems. However, user's input may contain implicit information, posing significant challenges for DST tasks. Additionally, DST data includes complex information, which not only contains a large amount of noise unrelated to the current turn, but also makes constructing DST datasets expensive. To address these challenges, we introduce Intent-driven In-context Learning for Few-shot DST (IDIC-DST). By extracting user's intent, we propose an Intent-driven Dialogue Information Augmentation module to augment the dialogue information, which can track dialogue states more effectively. Moreover, we mask noisy information from DST data and rewrite user's input in the Intent-driven Examples Retrieval module, where we retrieve similar examples. We then utilize a pre-trained large language model to update the dialogue state using the augmented dialogue information and examples. Experimental results demonstrate that IDIC-DST achieves state-of-the-art performance in few-shot settings on MultiWOZ 2.1 and MultiWOZ 2.4 datasets.
title Intent-driven In-context Learning for Few-shot Dialogue State Tracking
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2412.03270