ModelCloud
/

GPTQ-v2-Llama-3.1-8B-Instruct

4-bit precision

Model card Files Files and versions

Qubitium commited on Apr 17

Commit

1daef8d

·

verified ·

1 Parent(s): 5ea8129

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -35,6 +35,8 @@ with tempfile.TemporaryDirectory() as tmp_dir:
         print(make_table(results, "groups"))
 ```
 |      Tasks       |Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
 |------------------|------:|----------------|-----:|-----------|---|-----:|---|-----:|

         print(make_table(results, "groups"))
 ```
+Full quantization and eval reproduction code: https://github.com/ModelCloud/GPTQModel/issues/1545#issuecomment-2811997133
 |      Tasks       |Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
 |------------------|------:|----------------|-----:|-----------|---|-----:|---|-----:|