--- library_name: transformers pipeline_tag: text-generation tags: - mistral inference: false base_model: alpindale/Mistral-7B-v0.2-hf --- # Mistral-7B-v0.2-hf-GGUF - Quantized version of [Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf) - The model is created by [mistralai](https://huggingface.co/mistralai) and weights provided by [alpindale](https://huggingface.co/alpindale) - Created using llama.cpp ## Available Quants - Q2_K - Q3_K_L - Q3_K_M - Q3_K_S - Q4_0 - Q4_K_M - Q4_K_S - Q5_0 - Q5_K_M - Q5_K_S - Q6_K - Q8_0