File size: 176 Bytes
5fa1a76
 
 
1
2
3
Splinter
is an encoder-only transformer (similar to BERT) pretrained using the recurring span selection task on a large corpus
comprising Wikipedia and the Toronto Book Corpus.