Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,320

Full-text search

Active filters: quantized

nvidia/DeepSeek-R1-0528-FP4

Text Generation • Updated 3 days ago • 1.54k • 21

nvidia/DeepSeek-V3-0324-FP4

Text Generation • Updated 2 days ago • 84 • 4

QuantStack/Wan2.1_T2V_14B_FusionX_VACE-GGUF

Image-to-Video • Updated about 22 hours ago • 1.66k • 4

QuantStack/Phantom_Wan_14B_FusionX-GGUF

Image-to-Video • Updated about 15 hours ago • 461 • 4

QuantStack/Wan2.1_T2V_14B_FusionX-GGUF

Text-to-Video • Updated about 22 hours ago • 1.16k • 3

boltuix/bert-mini

Text Classification • Updated 5 days ago • 484 • 6

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19 • 5.86k • 30

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 14 days ago • 90.7k • 4

QuantStack/Wan2.1_I2V_14B_FusionX-GGUF

Image-to-Video • Updated 1 day ago • 1.21k • 2

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 25 days ago • 345k • 132

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 429 • 13

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 1.71k • 128

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 1.48k • 33

legraphista/openchat-3.6-8b-20240522-IMat-GGUF

Text Generation • Updated May 27, 2024 • 4.58k • 1

piotrmaciejbednarski/PLLuM-8x7B-chat-GGUF

Text Generation • Updated Mar 3 • 131 • 2

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated Mar 12 • 246k • 4

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • Updated 13 days ago • 3.25k • 7

boltuix/bert-lite

Text Classification • Updated 22 days ago • 422 • 9

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated Apr 22 • 134 • 7

boltuix/NeuroBERT-Small

Text Classification • Updated 21 days ago • 468 • 11

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 18 days ago • 414 • 24

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated 10 days ago • 1.59k • 6

tarun7r/sarvam-m-bnb-4bit

Text Generation • Updated 4 days ago • 34 • 1

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • Updated 3 days ago • 10 • 1

ReallyFloppyPenguin/Holo1-3B-GGUF

Updated 2 days ago • 33 • 1

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated 2 days ago • 89 • 1

botirk/tiny-prompt-task-complexity-classifier

Text Classification • Updated 24 minutes ago • 1

boltuix/NeuroBERT-Tiny

Text Classification • Updated 21 days ago • 422 • 11

boltuix/NeuroBERT-Mini

Text Classification • Updated 21 days ago • 446 • 10

boltuix/NeuroBERT

Text Classification • Updated 21 days ago • 508 • 10