before_revision: Previous works on neural text-to-speech (TTS) have been tackled on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability. Although several approaches resolve some limitations, none of them has resolved all weaknesses at once. In this paper, we propose STYLER, an expressive and controllable text-to-speech model with robust speech synthesisand high speed. Excluding autoregressive decoding and introducing a novel audio-text aligning method called Mel Calibrator leads speech synthesis more robust on long, unseen data. Disentangled style factor modeling under supervision enlarges the controllability of synthesizing speech with fruitful expressivity. Moreover, our novel noise modeling pipeline using domain adversarial training and Residual Decoding enables noise-robust style transfer, decomposing the noise without any additional label. Our extensive and various experiments demonstrate STYLER's effectiveness in the aspects of speed , robustness, expressiveness, and controllability by comparison with existing neural TTS models and ablation studies . Synthesis samples of our model and experiment results are provided via our demo page  .
after_revision: Previous works on neural text-to-speech (TTS) have been addressed on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability. Although several approaches resolve some limitations, there has been no attempt to solve all weaknesses at once. In this paper, we propose STYLER, an expressive and controllable TTS framework with high-speed and robust synthesis. Our novel audio-text aligning method called Mel Calibrator and excluding autoregressive decoding enable rapid training and inference and robust synthesis on unseen data. Also, disentangled style factor modeling under supervision enlarges the controllability in synthesizing process leading to expressive TTS. On top of it, a novel noise modeling pipeline using domain adversarial training and Residual Decoding empowers noise-robust style transfer, decomposing the noise without any additional label. Various experiments demonstrate that STYLER is more effective in speed and robustness than expressive TTS with autoregressive decoding and more expressive and controllable than reading style non-autoregressive TTS . Synthesis samples and experiment results are provided via our demo page , and code is available publicly .
edit_actions: R
edit_actions: tackled
edit_actions: addressed
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: none of them has resolved
edit_actions: there has been no attempt to solve
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: text-to-speech model with robust speech synthesisand high speed. Excluding autoregressive decoding and introducing a
edit_actions: TTS framework with high-speed and robust synthesis. Our
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: leads speech synthesis more robust on long,
edit_actions: and excluding autoregressive decoding enable rapid training and inference and robust synthesis on
edit_actions: clarity
edit_actions: clarity clarity style
edit_actions: R
edit_actions: Disentangled
edit_actions: Also, disentangled
edit_actions: coherence
edit_actions: coherence coherence coherence
edit_actions: R
edit_actions: of synthesizing speech with fruitful expressivity. Moreover, our
edit_actions: in synthesizing process leading to expressive TTS. On top of it, a
edit_actions: clarity
edit_actions: clarity meaning-changed clarity
edit_actions: R
edit_actions: enables
edit_actions: empowers
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: Our extensive and various experiments demonstrate STYLER's effectiveness in the aspects of speed , robustness, expressiveness, and controllability by comparison with existing neural TTS models and ablation studies
edit_actions: Various experiments demonstrate that STYLER is more effective in speed and robustness than expressive TTS with autoregressive decoding and more expressive and controllable than reading style non-autoregressive TTS
edit_actions: clarity
edit_actions: meaning-changed clarity clarity
edit_actions: D
edit_actions: of our model
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: A
edit_actions: , and code is available publicly
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed