Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,315

Full-text search

Active filters: quantized

nvidia/DeepSeek-R1-0528-FP4

Text Generation • Updated about 23 hours ago • 1.07k • 19

boltuix/bert-mini

Text Classification • Updated 2 days ago • 208 • 12

boltuix/bert-lite

Text Classification • Updated 20 days ago • 377 • 14

boltuix/NeuroBERT-Tiny

Text Classification • Updated 19 days ago • 326 • 16

boltuix/NeuroBERT-Small

Text Classification • Updated 19 days ago • 407 • 15

boltuix/NeuroBERT-Mini

Text Classification • Updated 19 days ago • 401 • 15

boltuix/NeuroBERT

Text Classification • Updated 19 days ago • 469 • 14

boltuix/NeuroBERT-Pro

Text Classification • Updated 19 days ago • 261 • 14

QuantStack/Wan2.1-14B-T2V-FusionX-VACE-GGUF

Image-to-Video • Updated 1 day ago • 328 • 3

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19 • 5.38k • 29

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 16 days ago • 404 • 24

QuantStack/Wan2.1-14B-I2V-FusionX-FP8-GGUF

Image-to-Video • Updated 1 day ago • 472 • 2

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 23 days ago • 338k • 132

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 439 • 13

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 1.63k • 128

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 1.41k • 33

legraphista/openchat-3.6-8b-20240522-IMat-GGUF

Text Generation • Updated May 27, 2024 • 4.5k • 1

MaziyarPanahi/ruadapt_qwen2.5_3B_ext_u48_instruct_v4-GGUF

Text Generation • Updated Oct 30, 2024 • 55 • 1

piotrmaciejbednarski/PLLuM-8x7B-chat-GGUF

Text Generation • Updated Mar 3 • 126 • 2

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated Mar 12 • 256k • 4

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 11 days ago • 9.78k • 5

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated Apr 22 • 132 • 7

RedHatAI/Qwen3-14B-FP8-dynamic

Text Generation • Updated 28 days ago • 184 • 1

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 12 days ago • 75.4k • 3

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated 8 days ago • 1.17k • 5

QuantStack/Wan2.1-14B-T2V-FusionX-GGUF

Text-to-Video • Updated 1 day ago • 445 • 1

tarun7r/sarvam-m-bnb-4bit

Text Generation • Updated 1 day ago • 28 • 1

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • Updated about 10 hours ago • 1

ReallyFloppyPenguin/Holo1-3B-GGUF

Updated 23 minutes ago • 1

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2