How did you quantised this model?
1
#3 opened about 1 year ago
by
Saksham54
4-bit quantization
#2 opened over 1 year ago
by
ibalampanis

This quant gives a terrifying output
👍
🤯
3
3
#1 opened over 1 year ago
by
alexcardo