Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-32B-q3f16_1-MLC

MLC-LLM
web-llm
Model card Files Community
JackBinary commited on
Commit
884f6d1
·
verified ·
1 Parent(s): dc7e2d8

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_0.bin +3 -0
  4. params_shard_102.bin +3 -0
  5. params_shard_103.bin +3 -0
  6. params_shard_107.bin +3 -0
  7. params_shard_108.bin +3 -0
  8. params_shard_111.bin +3 -0
  9. params_shard_114.bin +3 -0
  10. params_shard_115.bin +3 -0
  11. params_shard_117.bin +3 -0
  12. params_shard_121.bin +3 -0
  13. params_shard_122.bin +3 -0
  14. params_shard_127.bin +3 -0
  15. params_shard_129.bin +3 -0
  16. params_shard_131.bin +3 -0
  17. params_shard_133.bin +3 -0
  18. params_shard_135.bin +3 -0
  19. params_shard_139.bin +3 -0
  20. params_shard_14.bin +3 -0
  21. params_shard_140.bin +3 -0
  22. params_shard_141.bin +3 -0
  23. params_shard_143.bin +3 -0
  24. params_shard_147.bin +3 -0
  25. params_shard_149.bin +3 -0
  26. params_shard_155.bin +3 -0
  27. params_shard_158.bin +3 -0
  28. params_shard_16.bin +3 -0
  29. params_shard_165.bin +3 -0
  30. params_shard_168.bin +3 -0
  31. params_shard_177.bin +3 -0
  32. params_shard_179.bin +3 -0
  33. params_shard_18.bin +3 -0
  34. params_shard_180.bin +3 -0
  35. params_shard_182.bin +3 -0
  36. params_shard_19.bin +3 -0
  37. params_shard_191.bin +3 -0
  38. params_shard_193.bin +3 -0
  39. params_shard_196.bin +3 -0
  40. params_shard_197.bin +3 -0
  41. params_shard_198.bin +3 -0
  42. params_shard_202.bin +3 -0
  43. params_shard_205.bin +3 -0
  44. params_shard_211.bin +3 -0
  45. params_shard_212.bin +3 -0
  46. params_shard_214.bin +3 -0
  47. params_shard_215.bin +3 -0
  48. params_shard_217.bin +3 -0
  49. params_shard_223.bin +3 -0
  50. params_shard_245.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-32B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-32B-q3f16_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-32B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-32B) model in MLC format `q3f16_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q3f16_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q3f16_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q3f16_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efafd329faedd0467243cdca18e2162cf056807c5180dad741f9a838e4ca3afd
3
+ size 311427072
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fba46b116c8bd7be889ba006ea984cc25cebb3ffdf3cd3ab3d2903de0014821a
3
+ size 25999360
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81088a7b97d0856f35ee892cfc0244a791c4ca147d767871a6f81d0e59c0c7a5
3
+ size 30695424
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:605564d56d68918261763754deb97e4e2eeb768514d394d0c78680983143e7ee
3
+ size 56688640
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e061119b4b72c867d1838ef4976fc349f5a8e37ce4ca74aa50d70be95e40b12
3
+ size 28321792
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a1d1eb8e550b7e01e659b1410eb934a81ddf54c42df27df5d54924462c85920
3
+ size 56688640
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1153a96e452331bb9e6361030c94d24e6df63da4658b9c60d56620be92c53ae8
3
+ size 21266432
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9a5c7be9b71b6d06c5cab31c644702edf50135729f8bf71539ad4c9ded6e7ab
3
+ size 56688640
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6836b404edea90e987ab42e1bd16df9747275f067aa045310db058460caee8b1
3
+ size 113246208
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:324f1eba8e298def9e4f553e90a7866bf54d79aacddb1186ae35121f09f0fd34
3
+ size 113246208
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eea1fd3a3c49b0379a8939f6f242752036679d3e770c8361758d3750d23b8935
3
+ size 21266432
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88743e6d6c318ac5e40d6aed91ad7f56d48425598fb066b9d2e58ce7f46de4a0
3
+ size 56688640
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a93b58e6429a57c9a519404d95c33fa80b765638f6620d019b0c192792926acc
3
+ size 113246208
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e68ea2b645a8b86ab4007daefa8ac1a3d79183c9fca0b4548ba280689e202f7c
3
+ size 56688640
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10d0d706d9b004ed23537af52c1e551d240d92d402175a9e5822e81a11287ab5
3
+ size 113246208
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:436e6dee246b8b94a55ed6e0935de481450c30dbcf088349c9f1d7b7680a952b
3
+ size 113246208
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ad46e94d4ddc05ec5779b49ab9600efccb4382facd401301e1ed4ead18fd434
3
+ size 56688640
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6409db049bfb9905b24982b8e1d972bfdbd7db0ca57926f7e886c3202a7d8c45
3
+ size 21266432
params_shard_140.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68cbce9abcff914079a7eeb3e7962ab64ab820db85e5207351f3512d521af2f0
3
+ size 113246208
params_shard_141.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b053d85d458e86aea3c3f3a95eb111687bc585e0b32566b416c91f40cd34cdb8
3
+ size 25999360
params_shard_143.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:307f17c48fc8443653ea2630461cb364a8dfa031eae95cd32b9d4e3e60a9247a
3
+ size 56688640
params_shard_147.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e443359691b2bed654b00827ad8c2ad5553464dea10696b5f0c926ba7c72d46
3
+ size 28321792
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:071a7ab848926387bf78123ba2b382c648abd39ccd046b5958365f9578b4d294
3
+ size 21266432
params_shard_155.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba8a0a3f8079d27ba1911887540fa7f04eeadf6c29040498b9ee2620885a5ed9
3
+ size 28321792
params_shard_158.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0bff37d71233d09e2dec2d24324165b7b3818b9d9860d703016417db6979803
3
+ size 56688640
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed28031ff619cc3fceb8ebc230b36ba5206077b63611a93bdb3d0d8f9befe172
3
+ size 28321792
params_shard_165.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d4de65e5eda8229d4f1db2a3964546a7cd3db5f7aff8097e4294bad074fefed
3
+ size 21266432
params_shard_168.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c13138ed4347e651a5376d2fa42b1abe7df31c96d80445c56181ebc6e6bc9242
3
+ size 113246208
params_shard_177.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c24a2339345bc4ae87dfaff244055d4f1152e81cae96a859b19db1b6ba42c03
3
+ size 56688640
params_shard_179.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cabcf55d70e08393f3c87a356263ca16ff09622f6b5a49f2cdc40f0a907f100e
3
+ size 113246208
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df6690269ed4b715d1db6428fc95b516c09a21e8b041420e0ce06e9f7907832c
3
+ size 21266432
params_shard_180.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b14022ea491a1eaf888d9d8219d8a06837c6447ed19fd23a5d3df5c9db462dce
3
+ size 25999360
params_shard_182.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac94acbec540f5c61c70433acd05c56f2efb143e4a86723996867ecb8568663d
3
+ size 56688640
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:142107c860df2083a0e47b47093ea31921116e12a57f52bf166ab92c4328446b
3
+ size 56688640
params_shard_191.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3eb2b75e418c25f4c085d220978cea2b3b44a70a24e0aceecaf4794f5d0a708d
3
+ size 113246208
params_shard_193.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:966b63f954dc4ca31b038c94810e8051f65aae80b21ff6a1fb1036362f4f95c7
3
+ size 56688640
params_shard_196.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15757377bb91af4d1c267e0f258809a2d3b56ff421231fb3260f9fdcf5133998
3
+ size 21266432
params_shard_197.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a4da74f7195d9b82e56760d160be71bcf85fbd54f2b262136f8638b9916137d
3
+ size 56688640
params_shard_198.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69ba4516ed3deff4345993afa51eb87ab739221b929902a8c71a6366d3f9d331
3
+ size 28321792
params_shard_202.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfdc539c9a7cafc2e054ec197109cfb7eece75cdd73a3e44ddfb77b3ff30cf11
3
+ size 28321792
params_shard_205.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8733160224ded0c71f5fc17538247216aae636d23187a4dffcb477a6253b9269
3
+ size 56688640
params_shard_211.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f6e2932c334104c22943b2adb4160b685a3cfe461ef1ce064e6b6c15fd21f54
3
+ size 113246208
params_shard_212.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:024c91449d8af26d9e96961d7631ea022c8d26bd796093bcbfb559fe50746bda
3
+ size 21266432
params_shard_214.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ea17b5472d4aebf0d50114318bf0de0942ce77918fa21b173724675bec3cd9e
3
+ size 28311552
params_shard_215.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a2754846e6c035fa108495cd8430fe78465fb451ee9c6d017117409b7bc07f4
3
+ size 30685184
params_shard_217.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb0e096958d1c388ce7a38162fddc113732e86748a6e311866f9089faa5144b1
3
+ size 56688640
params_shard_223.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b55537feda6f68ba1f1cc451840b634beda45dfed53a1db85b8105c659f4e4a
3
+ size 33073152
params_shard_245.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b62a35ef200fd73593e243b25d52dfae5dd1d4ad8077355a45802bc19ca509eb
3
+ size 28321792