mistralai
/

Mistral-Nemo-Instruct-FP8-2407

Model card Files Files and versions

juliendenize commited on 27 days ago

Commit

6779aca

·

verified ·

1 Parent(s): 60061c7

Update params.json

Files changed (1) hide show

params.json +2 -1

params.json CHANGED Viewed

@@ -8,5 +8,6 @@
     "norm_eps": 1e-05,
     "vocab_size": 131072,
     "rope_theta": 1000000.0,
-    "quantization": {"qformat_weight": "fp8_e4m3"}
 }

     "norm_eps": 1e-05,
     "vocab_size": 131072,
     "rope_theta": 1000000.0,
+    "quantization": {"qformat_weight": "fp8_e4m3"},
+    "max_position_embeddings": 131072
 }