Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,761

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-6.9b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-6.9b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 4

Ksgk-fy/Llama-3-8B-Instruct-abliterated_gptq_prompt

Text Generation • 3B • Updated Jul 19, 2024 • 7

ModelCloud/DeepSeek-V2-Chat-0628-gptq-4bit

Text Generation • Updated Jul 20, 2024 • 9 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 4

navubolecou/semikong-8b-GGUF

Text Generation • 2B • Updated Jul 19, 2024 • 10

acl-srw-2024/llama-3-8b-instruct-cs-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 4

acl-srw-2024/llama-3-8b-instruct-scb-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 5

acl-srw-2024/llama-3-8b-instruct-scb-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 5

acl-srw-2024/llama-3-8b-instruct-cs-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 5

Xu-Ouyang/pythia-2.8b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 5

acl-srw-2024/llama-3-8b-instruct-scb-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 5

Xu-Ouyang/pythia-2.8b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 4

acl-srw-2024/llama-3-8b-instruct-cs-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 19, 2024 • 5

shuyuej/Command-R-Plus-GPTQ

Text Generation • 17B • Updated Jul 25, 2024 • 5 • 1

Xu-Ouyang/pythia-410m-deduped-int3-step14000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int3-step29000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 19, 2024 • 4

acl-srw-2024/llama-3-8b-instruct-scb-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 5

Xu-Ouyang/pythia-410m-deduped-int3-step43000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4

acl-srw-2024/llama-3-8b-instruct-cs-gptq-8bit

Text Generation • Updated Jul 20, 2024 • 7

Xu-Ouyang/pythia-2.8b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 5

Xu-Ouyang/pythia-410m-deduped-int3-step57000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int3-step86000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int3-step100000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-410m-deduped-int3-step115000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4

Xu-Ouyang/pythia-2.8b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 0.6B • Updated Jul 20, 2024 • 5

Xu-Ouyang/pythia-410m-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • 0.1B • Updated Jul 20, 2024 • 4