Hugging Face's logo

nvidia
/
Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Model card Files Community
3
xp1992slz commited on
Commit
e984511
·
verified ·
1 Parent(s): 45e12ef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -50,7 +50,7 @@ print(outputs[0]["generated_text"][-1])
50
  ## Model Card
51
 
52
  * Base model: [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)
53
- * Continued Pretraining: 1B tokens on 4M Per-source upsampled SlimPajama data.
54
  * Supervised fine-tuning (SFT): 1B tokens on open-source instruction datasets across general, mathematics, and code domains.
55
  * Maximum context window: 4M tokens
56
 
 
50
  ## Model Card
51
 
52
  * Base model: [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct)
53
+ * Continued Pretraining: 1B tokens on 4M Per-source upsampled Pretraining data.
54
  * Supervised fine-tuning (SFT): 1B tokens on open-source instruction datasets across general, mathematics, and code domains.
55
  * Maximum context window: 4M tokens
56