Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-14B-q0f16-MLC

MLC-LLM
web-llm
Model card Files Community
JackBinary commited on
Commit
ca06d87
·
verified ·
1 Parent(s): 77641a1

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_100.bin +3 -0
  4. params_shard_101.bin +3 -0
  5. params_shard_102.bin +3 -0
  6. params_shard_107.bin +3 -0
  7. params_shard_109.bin +3 -0
  8. params_shard_113.bin +3 -0
  9. params_shard_117.bin +3 -0
  10. params_shard_119.bin +3 -0
  11. params_shard_124.bin +3 -0
  12. params_shard_127.bin +3 -0
  13. params_shard_132.bin +3 -0
  14. params_shard_138.bin +3 -0
  15. params_shard_142.bin +3 -0
  16. params_shard_15.bin +3 -0
  17. params_shard_151.bin +3 -0
  18. params_shard_158.bin +3 -0
  19. params_shard_16.bin +3 -0
  20. params_shard_164.bin +3 -0
  21. params_shard_17.bin +3 -0
  22. params_shard_173.bin +3 -0
  23. params_shard_175.bin +3 -0
  24. params_shard_176.bin +3 -0
  25. params_shard_18.bin +3 -0
  26. params_shard_180.bin +3 -0
  27. params_shard_182.bin +3 -0
  28. params_shard_185.bin +3 -0
  29. params_shard_191.bin +3 -0
  30. params_shard_192.bin +3 -0
  31. params_shard_20.bin +3 -0
  32. params_shard_3.bin +3 -0
  33. params_shard_4.bin +3 -0
  34. params_shard_40.bin +3 -0
  35. params_shard_41.bin +3 -0
  36. params_shard_49.bin +3 -0
  37. params_shard_54.bin +3 -0
  38. params_shard_64.bin +3 -0
  39. params_shard_65.bin +3 -0
  40. params_shard_68.bin +3 -0
  41. params_shard_69.bin +3 -0
  42. params_shard_73.bin +3 -0
  43. params_shard_79.bin +3 -0
  44. params_shard_8.bin +3 -0
  45. params_shard_81.bin +3 -0
  46. params_shard_82.bin +3 -0
  47. params_shard_85.bin +3 -0
  48. params_shard_86.bin +3 -0
  49. params_shard_90.bin +3 -0
  50. params_shard_94.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-14B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-14B-q0f16-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-14B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-14B) model in MLC format `q0f16`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f16-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f16-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f16-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:366513afca9288965f66782668399c736a7bea4ab192ac7dd55d6fb4b21b8e8c
3
+ size 73400320
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47f15144b3bcfdbae1b0833087193d5ff0b28c1ecb6355a0bf7a8939056a3eb4
3
+ size 52428800
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb011f75368f5380948c0a10bda094f26df0c4fc98b82001ff0d9ffa5d5315f6
3
+ size 141557760
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07d61ac901ca07fb37d9fca54a91f9258e372c9ab9b89e6fec1c74bafec76030
3
+ size 283115520
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f524d21d359c7f3670e308cff265674f918e54737320f311c849879cda7d432c
3
+ size 52428800
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87fe8753ff992b7896a5249931631a70397c67fbf691a8ce8aa61e469b54af8a
3
+ size 52428800
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e1c9bf47b6b5f4fb308365d212515144e0581540ac3fc7264038dba9b942fa9
3
+ size 52428800
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d34fe1dc964e80f7ee91184704a8769c5b4038e19fcf08eee01d4592bccd548
3
+ size 283115520
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b96db0eb7bccb69413456181136ba1200b803bbe65c7050da7200f9120131293
3
+ size 141557760
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1384738ea6cfe65233a51c16fec30c00e5030494fbc2f1535f90abd07f351905
3
+ size 52428800
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:febcd050b46e3b1b0d33f6ca113fcd8cb39a5a951cfb76e65986c2ee8fb549b6
3
+ size 141557760
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cc539d7cdfde1962c8f316f03cd6458b62b56ef9a31be56b726e04063cc30be
3
+ size 73400320
params_shard_142.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89be1bce8febb905bdddf3c6e96b8c8d0aa21f1328709b8987c96e49ec2b6c75
3
+ size 73400320
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d13c72b9d9da026f894720e71279815e2141faa8147f0fcd16f5a72a7cad98cb
3
+ size 141557760
params_shard_151.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9546048e585bfd2bbf6ebbf6cc94813d8484214d3d441e7b04cdba2b4c883e30
3
+ size 52428800
params_shard_158.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cd95d4df4a444509f18f33503dd6eaa14930c875f86a68af7736509d250c1e1
3
+ size 73400320
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:984bd5b80d425d5829b6e0e8d3149410dd642c60ae277e7a6cf9cb94d8e7821b
3
+ size 283115520
params_shard_164.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b516531cfa39b92dc93b5b6043ced3e2e594116e427a56e3504ac0dc1bdb794
3
+ size 141557760
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10284a64937f4453d5645e7f31e76bd34bcca8ed14969843228f128c7db55044
3
+ size 73400320
params_shard_173.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2eba70c182d8c665c41cd98bc720517049aff743668e29364228d46393f9aa0a
3
+ size 283115520
params_shard_175.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a478929fbb788b1bd9c81bfa18225c42b08dfe9968a928072551366c281d5032
3
+ size 52428800
params_shard_176.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fbc2e69ed5b6befe34248ebaf57fb012e269201c910730cc6ad4060750db96f
3
+ size 141557760
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:021dc8bfe7be5ba3d416c9525fa5e485322a1bf46c1ea676cad23e850b2da664
3
+ size 52428800
params_shard_180.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80de22b28cde2311e3cf1eb8402c8dab6869d4f8f6a89b31ff631e596e9a29f6
3
+ size 141557760
params_shard_182.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffad7ee265d495cd627cd5e05eb180a5ef54f276e934841176fa8f3e86a234c5
3
+ size 73400320
params_shard_185.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f59196de3d1af2eca6ca54950340ed9892ff1ffc4e1f14ea328342c4d5af7e7
3
+ size 283115520
params_shard_191.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:996b6261925e10864c971a2390fcacf62ab4cf4d8d23e1bd4bcdaa82db7f957c
3
+ size 52428800
params_shard_192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04b168f9e255d974831a0069e32b03520e23ccf33aca930998398dff5a5ae4ce
3
+ size 73400320
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71c5c98e49cc914eeb41e611f2bed1675e5db0ceab7ac6faf57efff26c727400
3
+ size 283115520
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d30944d64aee17b47f1d6eb415686e9fb052933981b67fea66ef4725ee1f3db
3
+ size 141557760
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:803f92c41e23f02d7503b9275950f162061c9368f6051c0c2bb3e92a88d7cc4e
3
+ size 283115520
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b26f75e49ce4bc204563590b03f5e4c843e0f97454265b2639cbb5e0e3edbcc4
3
+ size 283115520
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a18eaefe2a350fb9c555df37605c051426421b20fce9b7dc11a9a7fd8a6099b
3
+ size 73400320
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b89d0c1ef92b0245a840e23f4cfffe5ce0066aafe85aa53d48041c0063116cf
3
+ size 73400320
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a19e0cba7d1d213deeebdc871ccb533c14108f7fe6d789c6df3915cd2aab45d2
3
+ size 52428800
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bad142c397b4c18bd450d7ab315822d9a089d9d2c3e22990c67992a6dc94e5f1
3
+ size 141557760
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3709080c0bca31421a79b058cef3babfe0a691204e357b2bc2e5b16ca9bae6a7
3
+ size 283115520
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b255b4eff44c8cd4fef1d9400d0fbc600dfb55487488b7569249afa5ac0fec81
3
+ size 141557760
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06fcab231b103cbda524fa50038bc91eb36354b010d186dfb3f052c33f77e2db
3
+ size 283115520
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3cf891cf200ffe1ad93e409efc55b566a9098a40ac8cd77c8743ff40eaebabd
3
+ size 283115520
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:945b4d283f01cdbbe41438907139e39925404a7c0850d85e0ed81e5bef8d3875
3
+ size 52428800
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91224f4129d8a68acd6d4aeb878475461817d26054cbf09457d14f400f2bc25f
3
+ size 283115520
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5e8541e93e1fb20772f2d266dd118b2a42178503d6d3f0b66772681f3673efc
3
+ size 283115520
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28efdb8472258c1e2f26866c334187fcad0b51bd57b7ba976932a1098634cec5
3
+ size 73400320
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63fc4cde3a85bd1c6c8faf4c60e32e428a6ee63a89d8ecc5829170c0af067659
3
+ size 283115520
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b83b1f7fc5631ea6d506393a2ba7adaea0919ce57dcacfd982337e8ebaee8b6
3
+ size 73400320
params_shard_90.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8a727780a2975573336454fd6d1d60f6b979c0dfff31900d626c62f889be456
3
+ size 141557760
params_shard_94.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:958c455449cc1b214190b8abe03172eb5992584a99510ba8881139a97d00ae51
3
+ size 141557760