Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
If your sequence_length is super regular, then batching is more likely to be VERY interesting, measure and push
it until you get OOMs.