svdq worse quality
#1
by
tazztone
- opened
looking at the examples in assets it seems the svdq quality tradeoff is quite large. isn't it supposed to be better than fp8?
Unfortunately, no, SVDQ-INT4 quantization isn't supposed to output better quality images than FP8, especially since this one was quantized from an FP8 model (FP16 isn't available). What it does do though is require less VRAM and significantly speed up the generation time, even compared to Q4 GGUF quantizations.
oh i if its from fp8 it makes sense that it's lower quality than from bf16 ig