before_revision: Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models are used to augment the training dataset, benefit certain NLP tasks. In this work, we extend this approach to the task of dialogue state tracking for goal-oriented dialogues, in which the data naturally exhibits a hierarchical structure over utterances and related annotations . Deep generative data augmentation for dialogue state tracking requires the generative model to be aware of the hierarchically structured data . We propose  Variational Hierarchical Dialog Autoencoder (VHDA) for modeling various aspects of goal-oriented dialogues , including linguistic and underlying annotation structures. Our experiments show that our  model is able to generate realistic and novel samples that improve the robustness of state-of-the-art dialogue state trackers, ultimately improving their final dialogue state tracking performances on several datasets .
after_revision: Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models are used to augment the training dataset, benefit certain NLP tasks. In this work, we extend this approach to the task of dialog state tracking for goal-oriented dialogs. Since, goal-oriented dialogs naturally exhibit a hierarchical structure over utterances and related annotations , deep generative data augmentation for the task requires the generative model to be aware of the hierarchical nature . We propose the Variational Hierarchical Dialog Autoencoder (VHDA) for modeling complete aspects of goal-oriented dialogs , including linguistic features and underlying structured annotations, namely dialog acts and goals. We also propose two training policies to mitigate issues that arise with training VAE-based models. Experiments show that our hierarchical model is able to generate realistic and novel samples that improve the robustness of state-of-the-art dialog state trackers, ultimately improving the dialog state tracking performances on various dialog domains. Surprisingly, the ability to jointly generate dialog features enables our model to outperform previous state-of-the-arts in related subtasks, such as language generation and user simulation .
edit_actions: R
edit_actions: dialogue
edit_actions: dialog
edit_actions: fluency
edit_actions: fluency clarity fluency
edit_actions: R
edit_actions: dialogues, in which the data naturally exhibits
edit_actions: dialogs. Since, goal-oriented dialogs naturally exhibit
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: R
edit_actions: . Deep
edit_actions: , deep
edit_actions: fluency
edit_actions: fluency fluency coherence
edit_actions: R
edit_actions: dialogue state tracking
edit_actions: the task
edit_actions: clarity
edit_actions: clarity clarity style
edit_actions: R
edit_actions: hierarchically structured data
edit_actions: hierarchical nature
edit_actions: clarity
edit_actions: clarity style clarity
edit_actions: A
edit_actions: the
edit_actions: fluency
edit_actions: coherence fluency fluency
edit_actions: R
edit_actions: various
edit_actions: complete
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed style
edit_actions: R
edit_actions: dialogues
edit_actions: dialogs
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: and underlying annotation structures. Our experiments
edit_actions: features and underlying structured annotations, namely dialog acts and goals. We also propose two training policies to mitigate issues that arise with training VAE-based models. Experiments
edit_actions: meaning-changed
edit_actions: coherence meaning-changed meaning-changed
edit_actions: A
edit_actions: hierarchical
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed style
edit_actions: R
edit_actions: dialogue
edit_actions: dialog
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: their final dialogue
edit_actions: the dialog
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: several datasets
edit_actions: various dialog domains. Surprisingly, the ability to jointly generate dialog features enables our model to outperform previous state-of-the-arts in related subtasks, such as language generation and user simulation
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed