before_revision: Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models are used to augment the training dataset, benefit certain NLP tasks. In this work, we extend this approach to the task of dialog state tracking for goal-oriented dialogs. Since, goal-oriented dialogs naturally exhibit a hierarchical structure over utterances and related annotations, deep generative data augmentation for the task requires the generative model to be aware of the hierarchical nature . We propose the Variational Hierarchical Dialog Autoencoder (VHDA) for modeling  complete aspects of goal-oriented dialogs, including linguistic features and underlying structured annotations, namely dialog acts and goals. We also propose two training policies to mitigate issues that arise with training VAE-based models. Experiments show that our hierarchical model is able to generate realistic and novel samples that improve the robustness of state-of-the-art dialog state trackers, ultimately improving the dialog state tracking performances on various dialog domains. Surprisingly, the ability to jointly generate dialog features enables our model to outperform previous state-of-the-arts in related subtasks, such as language generation and user simulation  .
after_revision: Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks. In this work, we extend this approach to the task of dialog state tracking for goal-oriented dialogs. Due to the inherent hierarchical structure of goal-oriented dialogs over utterances and related annotations, the deep generative model must be capable of capturing the coherence among different hierarchies and types of dialog features . We propose the Variational Hierarchical Dialog Autoencoder (VHDA) for modeling the complete aspects of goal-oriented dialogs, including linguistic features and underlying structured annotations, namely speaker information, dialog acts, and goals. The proposed architecture is designed to model each aspect of goal-oriented dialogs using inter-connected latent variables and learns to generate coherent goal-oriented dialogs from the latent spaces. To overcome training issues that arise from training complex variational models, we propose appropriate training strategies. Experiments on various dialog datasets show that our model improves the downstream dialog trackers' robustness via generative data augmentation. We also discover additional benefits of our unified approach to modeling goal-oriented dialogs: dialog response generation and user simulation , where our model outperforms previous strong baselines .
edit_actions: R
edit_actions: are used to augment
edit_actions: complement
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: D
edit_actions: certain
edit_actions: clarity
edit_actions: clarity clarity coherence
edit_actions: R
edit_actions: Since,
edit_actions: Due to the inherent hierarchical structure of
edit_actions: clarity
edit_actions: clarity coherence clarity
edit_actions: R
edit_actions: dialogs naturally exhibit a hierarchical structure
edit_actions: dialogs
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: deep generative data augmentation for the task requires the generative model to be aware of the hierarchical nature
edit_actions: the deep generative model must be capable of capturing the coherence among different hierarchies and types of dialog features
edit_actions: clarity
edit_actions: clarity style clarity
edit_actions: A
edit_actions: the
edit_actions: fluency
edit_actions: fluency coherence fluency
edit_actions: R
edit_actions: dialog acts
edit_actions: speaker information, dialog acts,
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: We also propose two training policies to mitigate
edit_actions: The proposed architecture is designed to model each aspect of goal-oriented dialogs using inter-connected latent variables and learns to generate coherent goal-oriented dialogs from the latent spaces. To overcome training
edit_actions: meaning-changed
edit_actions: meaning-changed style meaning-changed
edit_actions: R
edit_actions: with training VAE-based models. Experiments
edit_actions: from training complex variational models, we propose appropriate training strategies. Experiments on various dialog datasets
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: hierarchical model is able to generate realistic and novel samples that improve the robustness of state-of-the-art dialog state trackers, ultimately improving the dialog state tracking performances on various dialog domains. Surprisingly, the ability to jointly generate dialog features enables our model to outperform previous state-of-the-arts in related subtasks, such as language
edit_actions: model improves the downstream dialog trackers' robustness via generative data augmentation. We also discover additional benefits of our unified approach to modeling goal-oriented dialogs: dialog response
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: A
edit_actions: , where our model outperforms previous strong baselines
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed