before_revision: Improving neural machine translation (NMT) models using the back-translations of the monolingual target data (synthetic parallel data) is currently the state-of-the-art approach for training improved translation systems. The quality of the backward system - which is trained on the available parallel data and used for the back-translation - has been shown in many studies to affect the performance of the final NMT model. In low resource conditions, the available parallel data is usually not enough to train a backward model that can produce the qualitative synthetic data needed to train a standard translation model . This work proposes a self-training strategy where the output of the backward model is used to improve the model itself through the forward translation technique. The technique was shown to improve baseline low resource IWSLT'14 English-German and IWSLT'15 English-Vietnamese backward translation models by 11.06 and 1.5 BLEUs respectively. The synthetic data generated by the improved English-German backward model was used to train a forward model which out-performed another forward model trained using standard back-translation by 2.7 BLEU .
after_revision: Improving neural machine translation (NMT) models using the back-translations of the monolingual target data (synthetic parallel data) is currently the state-of-the-art approach for training improved translation systems. The target-side side monolingual data has been used in the back-translation approach to improve the forward (target) translation model. Whereas the success of the approach heavily relies on the additional parallel data generating model -- the backward model -- the aim of the approach is only targeted at improving the forward model. The back-translation approach was designed primarily to benefit from an additional data whose source-side is synthetic. But research works have shown that translation models can also benefit from additional data whose target-side is synthetic . This work proposes the use of the target-side data throughout the back-translation approach to improve both the backward and forward models. We explored using only the target-side monolingual data to improve the backward model through forward translation and the forward model through back-translation. Experimental results on English-German and English-Vietnamese low resource neural machine translation showed that the proposed approach outperforms baselines that use the traditional back-translation method .
edit_actions: R
edit_actions: quality of the backward system - which is trained on the available parallel data and used for the
edit_actions: target-side side monolingual data has been used in the
edit_actions: clarity
edit_actions: clarity clarity meaning-changed
edit_actions: R
edit_actions: - has been shown in many studies to affect the performance of the final NMT model. In low resource conditions, the available parallel data is usually not enough to train a backward model that can produce the qualitative synthetic data needed to train a standard translation model
edit_actions: approach to improve the forward (target) translation model. Whereas the success of the approach heavily relies on the additional parallel data generating model -- the backward model -- the aim of the approach is only targeted at improving the forward model. The back-translation approach was designed primarily to benefit from an additional data whose source-side is synthetic. But research works have shown that translation models can also benefit from additional data whose target-side is synthetic
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: R
edit_actions: a self-training strategy where the output of the backward model is used
edit_actions: the use of the target-side data throughout the back-translation approach to improve both the backward and forward models. We explored using only the target-side monolingual data
edit_actions: meaning-changed
edit_actions: meaning-changed style meaning-changed
edit_actions: R
edit_actions: model itself through the forward translation technique. The technique was shown to improve baseline low resource IWSLT'14
edit_actions: backward model through forward translation and the forward model through back-translation. Experimental results on
edit_actions: clarity
edit_actions: meaning-changed clarity clarity
edit_actions: D
edit_actions: IWSLT'15
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: backward translation models by 11.06 and 1.5 BLEUs respectively. The synthetic data generated by the improved English-German backward model was used to train a forward model which out-performed another forward model trained using standard
edit_actions: low resource neural machine translation showed that the proposed approach outperforms baselines that use the traditional
edit_actions: meaning-changed
edit_actions: meaning-changed coherence meaning-changed
edit_actions: R
edit_actions: by 2.7 BLEU
edit_actions: method
edit_actions: clarity
edit_actions: clarity clarity clarity