Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
or the parameter size is 1 instead of a larger multi-dimensional shape, this means the parameter is partitioned and this is a ZeRO-3 placeholder.