---
library_name: transformers
pipeline_tag: text-generation
tags:
- mistral
inference: false
base_model: alpindale/Mistral-7B-v0.2-hf
---

# Mistral-7B-v0.2-hf-GGUF
- Quantized version of [Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf)
- The model is created by [mistralai](https://huggingface.co/mistralai) and weights provided by [alpindale](https://huggingface.co/alpindale)
- Created using llama.cpp

## Available Quants

- Q2_K 
- Q3_K_L
- Q3_K_M
- Q3_K_S
- Q4_0 
- Q4_K_M
- Q4_K_S
- Q5_0
- Q5_K_M
- Q5_K_S
- Q6_K
- Q8_0