Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Following prior work on long-sequence transformers, we
evaluate Longformer on character-level language modeling and achieve state-of-the-art results on text8 and enwik8.