As a general rule, we want to make sure that a new model only depends on
[PreTrainedModel].