File size: 149 Bytes
5fa1a76
 
 
 
 
1
2
3
4
5
thon

inputs = tokenizer(sequence)

The tokenizer returns a dictionary with all the arguments necessary for its corresponding model to work properly.