Commit
·
489d1a0
verified
·
0
Parent(s):
:birthday: initial commit
Browse files- .gitattributes +37 -0
- DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf +3 -0
- DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf +3 -0
- DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf +3 -0
- DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf +3 -0
- DeepSeek-R1-Distill-Qwen-14B-Japanese.imatrix +3 -0
- README.md +34 -0
.gitattributes
ADDED
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
*.imatrix filter=lfs diff=lfs merge=lfs -text
|
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7156045f661056c966f63f019b3847cef06eb421828ba4c6f6a672877434e007
|
3 |
+
size 6383361920
|
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:00d4ed338e8a46436cde4ca4983deb979e98b4ba35b71936eebf49ddb9ff813c
|
3 |
+
size 8119840640
|
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:946952e46a0d68d8d9b4ed4d33d6f4aca3ea5670af5f0a8e1fc1b07fda2a8a78
|
3 |
+
size 8988110720
|
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a62289fb2fd9d74607b7d6b7ed7e18f2f2d2ff293c5c4c65b3b8e608050adb53
|
3 |
+
size 12124684160
|
DeepSeek-R1-Distill-Qwen-14B-Japanese.imatrix
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:98fcb873dcf727487da538087ac681c04adc7ff2604b66db89e1acb39101f582
|
3 |
+
size 8563594
|
README.md
ADDED
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
pipeline_tag: text-generation
|
4 |
+
language:
|
5 |
+
- ja
|
6 |
+
tags:
|
7 |
+
- japanese
|
8 |
+
- qwen2
|
9 |
+
- gguf
|
10 |
+
base_model:
|
11 |
+
- cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese
|
12 |
+
datasets:
|
13 |
+
- TFMC/imatrix-dataset-for-japanese-llm
|
14 |
+
---
|
15 |
+
|
16 |
+
# DeepSeek-R1-Distill-Qwen-14B-Japanese GGUF
|
17 |
+
|
18 |
+
## Model Description
|
19 |
+
|
20 |
+
This repository provides a GGUF quantized version of the [cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese](https://huggingface.co/cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese) model from [CyberAgent](https://cyberagent.ai).
|
21 |
+
|
22 |
+
## Choosing the Right Quantized Version
|
23 |
+
|
24 |
+
The choice of which quantized version to use depends your avilable VRAM:
|
25 |
+
|
26 |
+
|
27 |
+
- >= 8GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf`
|
28 |
+
- >= 12GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf`
|
29 |
+
- >= 12GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf`
|
30 |
+
- >= 16GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf`
|
31 |
+
|
32 |
+
## License
|
33 |
+
[MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE)
|
34 |
+
|