File size: 292 Bytes
5fa1a76 |
1 2 3 4 5 6 7 8 |
Load DistilGPT2 with [AutoModelForCausalLM]:
from transformers import AutoModelForCausalLM, TrainingArguments, Trainer
model = AutoModelForCausalLM.from_pretrained("distilbert/distilgpt2")
At this point, only three steps remain:
Define your training hyperparameters in [TrainingArguments]. |