5fa1a76
1
2
3
4
5
thon inputs = tokenizer(sequence) The tokenizer returns a dictionary with all the arguments necessary for its corresponding model to work properly.