Spaces:

Ahmadzei
/

RAG

Runtime error

added 3 more tables for large emb model

5fa1a76 over 1 year ago

175 Bytes

	gptq_config = GPTQConfig(bits=4, dataset=dataset, tokenizer=tokenizer)
	Load a model to quantize and pass the gptq_config to the [~AutoModelForCausalLM.from_pretrained] method.