Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

12

Full-text search

Active filters: 4.5-bit

ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_4.5bpw_H8

Text Generation • Updated Mar 27 • 6

ReadyArt/Anathema-V2-LLaMA-70B_EXL2_4.5bpw_H8

Text Generation • Updated Mar 27 • 5

Mawdistical/Feline-Clairvoyance-72B_EXL2_4.5bpw_H8

Updated Mar 29 • 4

ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_4.5bpw_H8

Text Generation • Updated Mar 30 • 5

Mawdistical/Wanton-Wolf-70B_EXL2_4.5bpw_H8

Updated Mar 30 • 4

ReadyArt/Gaslight-24B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 2 • 6

ReadyArt/Gaslit-Transgression-24B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 2 • 6

Mawdistical/Draconic-Tease-70B_EXL2_4.5bpw_H8

Updated Apr 7 • 5

Mawdistical/Vulpine-Seduction-70B_EXL2_4.5bpw_H8

Updated Apr 9 • 5

ReadyArt/Retrograde-Omega-M-22B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 10 • 6

Nimbz/MS3.2-PaintedFantasy-Visage-v2-33B-exl3-4.5bpw-h6

Text Generation • 10B • Updated 23 days ago • 4

Nimbz/SnowDrogito-RpR-32B_4.5bpw_H6_EXL3

Text Generation • 10B • Updated 22 days ago • 13