This is a 4-bit BitsAndBytes quantized version of ruGPT-3.5 13B, based on Gaivoronsky/ruGPT-3.5-13B-fp16

Downloads last month
11
Safetensors
Model size
6.76B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support