Saved in:
Bibliographic Details
Main Authors: Druart, Lucas, Vielzeuf, Valentin, Estève, Yannick
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2311.04923
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916306383536128
author Druart, Lucas
Vielzeuf, Valentin
Estève, Yannick
author_facet Druart, Lucas
Vielzeuf, Valentin
Estève, Yannick
contents In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three steps: transcription of the user's utterance, semantic extraction of the key concepts, and contextualization with the previously identified concepts. Such cascade approaches suffer from cascading errors and separate optimization. End-to-End approaches have been proven helpful up to the turn-level semantic extraction step. This paper goes one step further and provides (1) a novel approach for completely neural spoken DST, (2) an in depth comparison with a state of the art cascade approach and (3) avenues towards better context propagation. Our study highlights that jointly-optimized approaches are also competitive for contextually dependent tasks, such as Dialogue State Tracking (DST), especially in audio native settings. Context propagation in DST systems could benefit from training procedures accounting for the previous' context inherent uncertainty.
format Preprint
id arxiv_https___arxiv_org_abs_2311_04923
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Is one brick enough to break the wall of spoken dialogue state tracking?
Druart, Lucas
Vielzeuf, Valentin
Estève, Yannick
Computation and Language
Artificial Intelligence
Audio and Speech Processing
Signal Processing
In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three steps: transcription of the user's utterance, semantic extraction of the key concepts, and contextualization with the previously identified concepts. Such cascade approaches suffer from cascading errors and separate optimization. End-to-End approaches have been proven helpful up to the turn-level semantic extraction step. This paper goes one step further and provides (1) a novel approach for completely neural spoken DST, (2) an in depth comparison with a state of the art cascade approach and (3) avenues towards better context propagation. Our study highlights that jointly-optimized approaches are also competitive for contextually dependent tasks, such as Dialogue State Tracking (DST), especially in audio native settings. Context propagation in DST systems could benefit from training procedures accounting for the previous' context inherent uncertainty.
title Is one brick enough to break the wall of spoken dialogue state tracking?
topic Computation and Language
Artificial Intelligence
Audio and Speech Processing
Signal Processing
url https://arxiv.org/abs/2311.04923