Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,860

Full-text search

Active filters: compressed-tensors

ccpfoye/MNLP_M3_W8A8

Text Generation • Updated 3 days ago • 43

ccpfoye/MNLP_M3_FP8_DYNAMIC

Text Generation • Updated 3 days ago • 50

mina5rovic/m2_w4a8

Text Generation • Updated 3 days ago • 16

oskdabk/platypus_GPTQ_W4A8

Text Generation • Updated 3 days ago • 11

oskdabk/platypus_GPTQ_W8A16

Text Generation • Updated 3 days ago • 7

oskdabk/platypus_GPTQ_W4A16

Text Generation • Updated 3 days ago • 5

daslab-testing/DeepSeek-R1-0528-Qwen3-8B-Quantized.w4a16

Updated 3 days ago • 41

oskdabk/platypus_GPTQ_W8A8

Text Generation • Updated 3 days ago • 1

TheS3b/Qwen3-0.6B-SmoothQuant-W8A8-calib20

Text Generation • Updated 1 day ago • 7

TheS3b/Qwen3-0.6B-SmoothQuant-W8A8-calib200

Text Generation • Updated 1 day ago • 7

anfindsen/MNLP_M3_quantized_model_GPTQ_owndata_W4A16

Text Generation • Updated 3 days ago • 43

TheS3b/Qwen3-0.6B-SmoothQuant-W8A8-calib2000

Text Generation • Updated about 24 hours ago • 3

anfindsen/MNLP_M3_quantized_model_GPTQ_owndata_W8A8

Text Generation • Updated 3 days ago • 22

anfindsen/MNLP_M3_quantized_model_GPTQ_owndata_W8A16

Text Generation • Updated 3 days ago • 11

RasmusVeski/MNLP_M3_quantized_model_GPTQ_owndata_W4A16

Text Generation • Updated 3 days ago • 15

RasmusVeski/MNLP_M3_quantized_model_GPTQ_owndata_W8A16

Text Generation • Updated 3 days ago • 13

RasmusVeski/MNLP_M3_quantized_model_GPTQ_owndata_W8A8

Text Generation • Updated 3 days ago • 18

Kikinoking/MNLP_M3_Kikinoking_mcqa_model_llm-tensorsW8A8

Updated 3 days ago • 3

tranhuonglan/MCQA_Qwen3-06B-base_GPTQW4A16

Text Generation • Updated 3 days ago • 10

tranhuonglan/Qwen3-06B-base-gptq-W8A8

Text Generation • Updated 3 days ago • 9

RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W4A16

Text Generation • Updated 3 days ago • 43

RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W8A16

Text Generation • Updated 3 days ago • 14

RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W8A8

Text Generation • Updated 3 days ago • 14

tranhuonglan/MCQA_Qwen3-06B-base_GPTQ_W8A16

Text Generation • Updated 3 days ago • 39

tranhuonglan/MCQA_Qwen3-06B-base_1_gpuGPTQ_W8A16

Text Generation • Updated 3 days ago • 44

tranhuonglan/MCQA_Qwen3-06B-base_1_gpuGPTQ_W4A16

Text Generation • Updated 3 days ago • 42

RasmusVeski/MNLP_M3_quantized_model_GPTQ_platypus_W8A8

Text Generation • Updated 3 days ago • 39

tranhuonglan/MCQA_Qwen3-06B-base_1_gpuGPTQ_W8A8

Text Generation • Updated 3 days ago • 68

mesolitica/Qwen2.5-72B-Instruct-FP8

Updated about 24 hours ago • 14

casimiir/Qwen3-0.6B-Base-llmcompressor-gptq-w8a8

Text Generation • Updated 3 days ago • 22