aplulu commited on
Commit
489d1a0
·
verified ·
0 Parent(s):

:birthday: initial commit

Browse files
.gitattributes ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
37
+ *.imatrix filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7156045f661056c966f63f019b3847cef06eb421828ba4c6f6a672877434e007
3
+ size 6383361920
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00d4ed338e8a46436cde4ca4983deb979e98b4ba35b71936eebf49ddb9ff813c
3
+ size 8119840640
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:946952e46a0d68d8d9b4ed4d33d6f4aca3ea5670af5f0a8e1fc1b07fda2a8a78
3
+ size 8988110720
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a62289fb2fd9d74607b7d6b7ed7e18f2f2d2ff293c5c4c65b3b8e608050adb53
3
+ size 12124684160
DeepSeek-R1-Distill-Qwen-14B-Japanese.imatrix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98fcb873dcf727487da538087ac681c04adc7ff2604b66db89e1acb39101f582
3
+ size 8563594
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: text-generation
4
+ language:
5
+ - ja
6
+ tags:
7
+ - japanese
8
+ - qwen2
9
+ - gguf
10
+ base_model:
11
+ - cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese
12
+ datasets:
13
+ - TFMC/imatrix-dataset-for-japanese-llm
14
+ ---
15
+
16
+ # DeepSeek-R1-Distill-Qwen-14B-Japanese GGUF
17
+
18
+ ## Model Description
19
+
20
+ This repository provides a GGUF quantized version of the [cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese](https://huggingface.co/cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese) model from [CyberAgent](https://cyberagent.ai).
21
+
22
+ ## Choosing the Right Quantized Version
23
+
24
+ The choice of which quantized version to use depends your avilable VRAM:
25
+
26
+
27
+ - >= 8GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf`
28
+ - >= 12GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf`
29
+ - >= 12GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf`
30
+ - >= 16GB VRAM: `DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf`
31
+
32
+ ## License
33
+ [MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE)
34
+