Update README.md
Browse files
README.md
CHANGED
@@ -6,4 +6,4 @@ tags:
|
|
6 |
- gptq
|
7 |
- q8_0
|
8 |
---
|
9 |
-
GPTQ Q8 quantized version of DeepSeek R1 Distill 7B under Apache 2.0 license. Enjoy
|
|
|
6 |
- gptq
|
7 |
- q8_0
|
8 |
---
|
9 |
+
GPTQ Q8 quantized version of DeepSeek R1 Distill 7B under Apache 2.0 license. Note, this version is not compatible with ExLlamaV2, but does work with V1 or Transformers. Enjoy
|