---
license: apache-2.0
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Llama-8B
tags:
- gptq
- q8_0
pipeline_tag: text-generation
---
GPTQ Q8 quantized version of DeepSeek R1 Distill 7B under Apache 2.0 license.  Note, this version is not compatible with ExLlamaV2, but does work with V1 or Transformers. Enjoy