Hugging Face's logo

lmz
/
candle-quantized-t5

Text2Text Generation
Transformers
Safetensors
GGUF
t5
text-generation-inference
Model card Files Community
3

Flan-t5-xl.gguf missing

#2
by bayang - opened
Discussion
bayang
•
edited Dec 8, 2023

Can I do a PR to your repo? just to contribute.
xl GGUF on your github

lmz
 Owner

Sure thing!

bayang

What x-bit integer quantization support did you use to generate the flan-t5-large.gguf ?
(q6k)?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment