RedHatAI
/

Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions

nm-research commited on Dec 19, 2024

Commit

39413ed

·

verified ·

1 Parent(s): 1ba4bbc

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -22,6 +22,7 @@ metrics:
   - **Output:** Text
 - **Model Optimizations:**
   - **Sparsity:** 2:4
 - **Release Date:** 11/21/2024
 - **Version:** 1.0
 - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)

   - **Output:** Text
 - **Model Optimizations:**
   - **Sparsity:** 2:4
+  - **Weight quantization:** INT4
 - **Release Date:** 11/21/2024
 - **Version:** 1.0
 - **License(s):** [llama3.1](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B/blob/main/LICENSE)