Hugging Face's logo

RedHatAI
/
Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text
Safetensors
vllm
mistral3
neuralmagic
redhat
llmcompressor
quantized
int4
conversational
compressed-tensors
Model card Files
xet
Community
4

Mistral small 3.2 is out

#4
by zacksiri - opened
Discussion
zacksiri

https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506

Would be nice if RedHatAI could provide the quantized versions.

Sign up or log in to comment