Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
!/usr/bin/env python
This script demonstrates how to use Deepspeed ZeRO in an inference mode when one can't fit a model
into a single GPU
1.