Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,326

Full-text search

Active filters: quantized

QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF

Image-to-Video • Updated 3 days ago • 4.82k • 11

QuantStack/Wan2.1_I2V_14B_FusionX-GGUF

Image-to-Video • Updated 3 days ago • 3.11k • 10

nvidia/DeepSeek-R1-0528-FP4

Text Generation • Updated 5 days ago • 3.22k • 22

QuantStack/Phantom_Wan_14B_FusionX-GGUF

Image-to-Video • Updated 2 days ago • 1.74k • 7

nvidia/DeepSeek-V3-0324-FP4

Text Generation • Updated 4 days ago • 120 • 4

QuantStack/Wan2.1_T2V_14B_FusionX-GGUF

Text-to-Video • Updated 3 days ago • 2.28k • 4

boltuix/bert-mini

Text Classification • Updated about 20 hours ago • 568 • 8

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 16 days ago • 107k • 4

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated 12 days ago • 1.71k • 7

boltuix/bert-lite

Text Classification • Updated 23 days ago • 405 • 10

boltuix/NeuroBERT-Small

Text Classification • Updated 23 days ago • 475 • 12

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 242 • 11

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 27 days ago • 345k • 132

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 1.59k • 33

legraphista/openchat-3.6-8b-20240522-IMat-GGUF

Text Generation • Updated May 27, 2024 • 4.67k • 1

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 210k • 45

jackboyla/Phi-3-mini-4k-instruct-graph-GGUF

Text Generation • Updated Dec 7, 2024 • 27 • 2

piotrmaciejbednarski/PLLuM-8x7B-chat-GGUF

Text Generation • Updated Mar 3 • 139 • 2

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated Mar 12 • 253k • 4

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • Updated 15 days ago • 3.25k • 7

boltuix/NeuroBERT-Tiny

Text Classification • Updated 22 days ago • 439 • 12

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 15 days ago • 8.67k • 21

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated Apr 22 • 137 • 7

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19 • 5.1k • 30

boltuix/NeuroBERT-Mini

Text Classification • Updated 23 days ago • 451 • 11

boltuix/NeuroBERT

Text Classification • Updated 23 days ago • 514 • 11

boltuix/NeuroBERT-Pro

Text Classification • Updated 23 days ago • 326 • 11

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 19 days ago • 424 • 24

tarun7r/sarvam-m-bnb-4bit

Text Generation • Updated 5 days ago • 38 • 1

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • Updated 4 days ago • 14 • 1