Put those pretrained weights in your random model.