Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Longformer Self Attention
Longformer self attention employs self attention on both a "local" context and a "global" context.