Alternatively, you can directly download the checkpoints using: | |
wget --content-disposition https://api.ngc.nvidia.com/v2/models/nvidia/megatron_lm_345m/versions/v0.0/zip -O | |
megatron_gpt2_345m_v0_0.zip | |
Once you have obtained the checkpoint from NVIDIA GPU Cloud (NGC), you have to convert it to a format that will easily | |
be loaded by Hugging Face Transformers GPT2 implementation. |