EXL3 models for 32GB VRAM - a DeusImperator Collection

DeusImperator 's Collections

EXL3 models for 32GB VRAM

EXL2 70B for 24GB VRAM

Small models 8bpw EXL2 quants

Mid-range models exl2 quants

Exl2 8bpw MAX quants

EXL3 models for 32GB VRAM

updated Jul 1

LLMs in EXL3 format that fit into 32GB VRAM

DeusImperator/Legion-V2.1-LLaMa-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated May 28 • 3
DeusImperator/L3.3-MS-Nevoria-70b_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 1 • 8
DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9 • 6
DeusImperator/Strawberrylemonade-70B-v1.2_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 27 • 8 • 1
DeusImperator/Anubis-70B-v1.1_exl3_3.0bpw_H6

14B • Updated Jul 1 • 20