Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
The input of the encoder is the corrupted sentence, the input of the decoder is the original sentence and the target is then the dropped out tokens delimited by their sentinel tokens.