Will you release the imatrix.dat used for the quants?
#2
by
tdh111
- opened
It is useful for anyone who wants to make their own custom quants.
https://huggingface.co/bartowski/deepseek-ai_DeepSeek-V3-0324-GGUF/tree/main
deepseek-ai_DeepSeek-V3-0324.imatrix
https://www.reddit.com/r/LocalLLaMA/comments/1jji2da/comment/mjnbkrf
Looks like unsloth is using this imatrix file for now
Yes we will be using bartowskis!