Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Next sentence prediction is replaced by a sentence ordering prediction: in the inputs, we have two sentences A and B (that are consecutive) and we either feed A followed by B or B followed by A.