Hugging Face's logo

SistInf
/
Velvet-14B-GGUF

Transformers
GGUF
vllm
conversational
Model card Files Community
marco-giachin commited on
Commit
ec89a72
·
verified ·
1 Parent(s): 1e74152

Update README.md

Browse files

Added Q4_K_S Download link

Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -48,6 +48,7 @@ Prompt format with system message:
48
  | BF16 | [Velvet-14B-BF16](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-BF16.gguf) |
49
  | F16 | [Velvet-14B-F16.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-F16.gguf) |
50
  | Q4_K_M | [Velvet-14B-Q4_K_M](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q4_K_M.gguf) |
 
51
  | Q5_K_M | [Velvet-14B-Q5_K_M](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q5_K_M.gguf) |
52
  | Q6_K | [Velvet-14B-Q6_K.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q6_K.gguf) |
53
  | Q8_0 | [Velvet-14B-Q8_0.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q8_0.gguf) |
 
48
  | BF16 | [Velvet-14B-BF16](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-BF16.gguf) |
49
  | F16 | [Velvet-14B-F16.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-F16.gguf) |
50
  | Q4_K_M | [Velvet-14B-Q4_K_M](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q4_K_M.gguf) |
51
+ | Q4_K_S | [Velvet-14B-Q4_K_S](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q4_K_S.gguf) |
52
  | Q5_K_M | [Velvet-14B-Q5_K_M](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q5_K_M.gguf) |
53
  | Q6_K | [Velvet-14B-Q6_K.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q6_K.gguf) |
54
  | Q8_0 | [Velvet-14B-Q8_0.gguf](https://huggingface.co/SistInf/Velvet-14B-GGUF/blob/main/Velvet-14B-Q8_0.gguf) |