- The model conversion script is the same as for the Llama2 family: | |
Here is a sample usage: | |
python src/transformers/models/llama/convert_llama_weights_to_hf.py \ | |
--input_dir /path/to/downloaded/llama/weights --model_size 7B --output_dir /output/path | |
Note that executing the script requires enough CPU RAM to host the whole model in float16 precision (even if the biggest versions | |
come in several checkpoints they each contain a part of each weight of the model, so we need to load them all in RAM). |