Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

16,478

Full-text search

Active filters: gguf-my-repo

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated 19 days ago • 339 • 18

openfree/QwQ-R1984-32B-Q4_K_M-GGUF

Updated 19 days ago • 2.34k • 21

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.29k • 21

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated 20 days ago • 1.67k • 16

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated 20 days ago • 1.94k • 20

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.69k • 21

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.24k • 20

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.86k • 15

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 20 days ago • 5.58k • 13

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

Text Generation • Updated 20 days ago • 2.42k • 17

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.4k • 15

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

Text Generation • Updated 20 days ago • 2.63k • 13

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated 20 days ago • 3.03k • 17

openfree/Qwen2.5-VL-32B-Instruct-Q8_0-GGUF

Image-Text-to-Text • Updated 20 days ago • 2.09k • 16

openfree/Qwen2.5-VL-32B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated 20 days ago • 4.16k • 16

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated 20 days ago • 3.14k • 13

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated Feb 24 • 98 • 4

YorkieOH10/Meta-Llama-3.1-8B-Instruct-hf-Q4_K_M-GGUF

Updated Jul 23, 2024 • 114 • 3

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Updated Oct 31, 2024 • 3.02k • 25

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 23 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 161 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 32 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 229 • 2

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated Feb 18 • 34 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated Feb 24 • 55 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 12 • 326 • 2

Nasa1423/RolmOCR-Q4_K_M-GGUF

Updated 13 days ago • 367 • 4

NikolayKozloff/ReZero-v0.1-llama-3.2-3b-it-grpo-250404-Q8_0-GGUF

Updated 2 days ago • 29 • 2

NikolayKozloff/granite-3.3-8b-instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 29 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 17.6k • 4