Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,900

Full-text search

Active filters: compressed-tensors

HAissa/M3_smoothquant094

Text Generation • Updated 8 days ago • 13

tranhuonglan/Qwen3-06B-base-quantization-modifier-W4A8

Text Generation • Updated 8 days ago • 7

tranhuonglan/Qwen3-06B-base-gptq-W8A16

Text Generation • Updated 8 days ago • 33

HAissa/M3_smoothquant096

Text Generation • Updated 8 days ago • 44

HAissa/M3_smoothquant098

Text Generation • Updated 8 days ago • 45

boboliu/Qwen3-Reranker-0.6B-W4A16-G128

Text Classification • Updated 8 days ago • 48

boboliu/Qwen3-Reranker-4B-W4A16-G128

Text Classification • Updated 8 days ago • 131

boboliu/Qwen3-Reranker-8B-W4A16-G128

Text Classification • Updated 8 days ago • 68

Wfiles/GPTQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W4

Updated 8 days ago • 13

Kikinoking/MNLP_M2_mcqa_model_llm-tensorsW8A8

Updated 8 days ago • 14

batistaolucca/Meta-Llama-3-8B-Instruct-W4A16-G128

Updated 8 days ago • 54

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.1

Updated 8 days ago • 7

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.2

Updated 8 days ago • 10

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.3

Updated 8 days ago • 8

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.4

Updated 8 days ago • 17

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.5

Updated 8 days ago • 11

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.6

Updated 7 days ago • 7

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.7

Updated 7 days ago • 8

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.8

Updated 7 days ago • 8

Wfiles/GPTQ_SQ_Final_MCQA_Crazy_LoRA_B4_WD0.01_LR1e-05_DB_SciQ_OnlyProj_E5_W8A8_0.9

Updated 7 days ago • 7

arthurrpp/Qwen3-0.6B-W8A8

Updated 7 days ago • 11

luciehmct/MNLP_M3_quantized_model_w4a4-1024

Text Generation • Updated 7 days ago • 93

luciehmct/MNLP_M3_quantized_model_w8a8-1024

Text Generation • Updated 4 days ago • 28

NewEden/ArliAI_R1-Distill-70B-ArliAI-RpR-v4-Large-FP8

Updated 7 days ago • 35

luciehmct/MNLP_M3_quantized_model_w8a8-2048

Text Generation • Updated 7 days ago • 58

clejordan/MNLP_M3_W8A8llmcompressor_lowsmooth

Text Generation • Updated 7 days ago • 28

RasmusVeski/OLD_GPTQ_owndata_W8A16

Text Generation • Updated 7 days ago • 1

luciehmct/MNLP_M3_quantized_model_w4a16-1024

Text Generation • Updated 7 days ago • 12

clejordan/MNLP_M3_W8A8llmcompressor_highsmooth

Text Generation • Updated 7 days ago • 51

clejordan/MNLP_M3_W8A8llmcompressor_verylowsmooth

Text Generation • Updated 7 days ago • 21