File size: 332 Bytes
5fa1a76 |
1 2 3 4 5 6 7 |
Tokenize the text and return the input_ids as PyTorch tensors:
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("username/my_awesome_eli5_clm-model")
inputs = tokenizer(prompt, return_tensors="pt").input_ids
Use the [~transformers.generation_utils.GenerationMixin.generate] method to generate text. |