File size: 141 Bytes
5fa1a76
 
 
 
 
1
2
3
4
5
!/usr/bin/env python
This script demonstrates how to use Deepspeed ZeRO in an inference mode when one can't fit a model
into a single GPU

1.