Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
It should look similar to this:
thon
from transformers import BrandNewBertTokenizer
input_str = "This is a long example input string containing special characters .$?-, numbers 2872 234 12 and words."