File size: 200 Bytes
5fa1a76
 
 
 
1
2
3
4
It should look similar to this:
thon
from transformers import BrandNewBertTokenizer
input_str = "This is a long example input string containing special characters .$?-, numbers 2872 234 12 and words."