If you want to use more than 1 GPU, you must use a multi-process environment for DeepSpeed to work.