If you want everything automatically taken care of for you, try using DeepSpeed with the [Trainer]!