Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
ZeRO Inference shares the same configuration file as ZeRO-3, and ZeRO-2 and ZeRO-1 configs won't work because they don't provide any benefits for inference.