Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Splinter
is an encoder-only transformer (similar to BERT) pretrained using the recurring span selection task on a large corpus
comprising Wikipedia and the Toronto Book Corpus.