RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W8A8 Text Generation • 0.6B • Updated Jun 7 • 18
RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W8A16 Text Generation • 0.3B • Updated Jun 7 • 18
RasmusVeski/MNLP_M3_quantized_model_llmcompressor_PTQ_W4A16 Text Generation • 0.2B • Updated Jun 7 • 18
RasmusVeski/MNLP_M3_quantized_model_bitsandbytes4bit_16ac_nested Text Generation • 0.4B • Updated Jun 7 • 7