Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-32B-q4f32_1-MLC

MLC-LLM
web-llm
Model card Files Community
JackBinary commited on
Commit
f2e5ac8
·
verified ·
1 Parent(s): 998caed

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +52 -0
  2. params_shard_1.bin +3 -0
  3. params_shard_103.bin +3 -0
  4. params_shard_120.bin +3 -0
  5. params_shard_123.bin +3 -0
  6. params_shard_128.bin +3 -0
  7. params_shard_129.bin +3 -0
  8. params_shard_13.bin +3 -0
  9. params_shard_131.bin +3 -0
  10. params_shard_136.bin +3 -0
  11. params_shard_140.bin +3 -0
  12. params_shard_141.bin +3 -0
  13. params_shard_143.bin +3 -0
  14. params_shard_145.bin +3 -0
  15. params_shard_146.bin +3 -0
  16. params_shard_154.bin +3 -0
  17. params_shard_155.bin +3 -0
  18. params_shard_156.bin +3 -0
  19. params_shard_157.bin +3 -0
  20. params_shard_160.bin +3 -0
  21. params_shard_162.bin +3 -0
  22. params_shard_163.bin +3 -0
  23. params_shard_166.bin +3 -0
  24. params_shard_168.bin +3 -0
  25. params_shard_169.bin +3 -0
  26. params_shard_170.bin +3 -0
  27. params_shard_172.bin +3 -0
  28. params_shard_174.bin +3 -0
  29. params_shard_177.bin +3 -0
  30. params_shard_178.bin +3 -0
  31. params_shard_179.bin +3 -0
  32. params_shard_187.bin +3 -0
  33. params_shard_188.bin +3 -0
  34. params_shard_19.bin +3 -0
  35. params_shard_193.bin +3 -0
  36. params_shard_196.bin +3 -0
  37. params_shard_197.bin +3 -0
  38. params_shard_202.bin +3 -0
  39. params_shard_206.bin +3 -0
  40. params_shard_212.bin +3 -0
  41. params_shard_213.bin +3 -0
  42. params_shard_215.bin +3 -0
  43. params_shard_217.bin +3 -0
  44. params_shard_22.bin +3 -0
  45. params_shard_220.bin +3 -0
  46. params_shard_222.bin +3 -0
  47. params_shard_223.bin +3 -0
  48. params_shard_224.bin +3 -0
  49. params_shard_227.bin +3 -0
  50. params_shard_233.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-32B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-32B-q4f32_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-32B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-32B) model in MLC format `q4f32_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q4f32_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q4f32_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q4f32_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91038e66fe12b0b6a1abbff02af88c92ae436d5ff1180ff6512da4b388b090ef
3
+ size 48660480
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f1b5ab45b26a5fd87999029120e7c5770510767795145f5cc5568e07e4a220f
3
+ size 25921536
params_shard_120.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4458b0f17de9f815440613edea91f10c7eaaccbf37c5636ebbfb46f80920ce3a
3
+ size 141557760
params_shard_123.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00fbb7ca343f955ae3a23675f5c11c065fe8d63577f77958204e126067a568b2
3
+ size 70778880
params_shard_128.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ed45c724b82923d708d526c643cd8ba9836e6ddb67c17d5c09d8f1339240372
3
+ size 32495616
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ed7d86ab09651fa08c8c30ed94b6d2e8cc4716224c6ef2bf44e0da7d6d38905
3
+ size 70778880
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:903628beb8d20f038580e5d8a549cdde25084903f4f09bcf61a80dbe4d3f152b
3
+ size 25921536
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc887f850499ab5a0deef15cf719e0e9db264a42f24dbaaabcc5347a7c4d17b9
3
+ size 17694720
params_shard_136.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b8ad5b52b9950bc82c09b627aa697c98a3e42b48a87508eb2727c8d3e82f49a
3
+ size 17694720
params_shard_140.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c73c821fd38f5f245da68d65866296f201f38f7252a5589b336c5ac76c17d3a
3
+ size 141557760
params_shard_141.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f02da7aa6c7994c5335871f37544929417a31c82066f4198e48768248adbe910
3
+ size 17694720
params_shard_143.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1fdcde08e9f54fe556aa6efbdbbd8035d7af34d46be0cdde1846fc68c279ddd
3
+ size 25921536
params_shard_145.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb7eb66b9307bbd6e9a2ee70914ef2872ff43ceba9b5360d414c288dcce1eeea
3
+ size 141557760
params_shard_146.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:033a846b94984d6eb5eaf1f829aaf911f217deb6f6fb78a65ae542461d62974c
3
+ size 17694720
params_shard_154.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d218d090f9b2829331e7afe5b2f88f1710a7a24d8b925b829c03bc532946895e
3
+ size 70778880
params_shard_155.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cd884ed6f26b46ec68fedbd4c35729f1282ef3596d1ce42c472bf6729068004
3
+ size 141557760
params_shard_156.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30fe6bd464122595f99289b1558c57054be9530e24c0c74fc4fff109515579f7
3
+ size 17694720
params_shard_157.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95fb4683cbe1ccd6f1323cfa5daba61b306dfcfedb746b4305c598ede40fd154
3
+ size 18350080
params_shard_160.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6342e8284247317938e609e76d1203fdab4bfd41ea0ea9e9dba91832e4aae52f
3
+ size 141557760
params_shard_162.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:962df73ce04fab1a9b2ad13d1c40e477b0fcd367ee92a50a078f837a669fb55b
3
+ size 18350080
params_shard_163.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a826eaa9b367f6a7714e5b140aac5eaa467849c9794a6a40154b8ecb1c117178
3
+ size 25921536
params_shard_166.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5da602bda10f6ad0e120d7bf3e5b1f4f194c4860f4eff159865648f3d2c7637f
3
+ size 17694720
params_shard_168.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d12abf6ed0a3fee7e0a627ef7960b89170b8df15571a5484d9348163695a37a
3
+ size 25921536
params_shard_169.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2632cc3155014cf589475cfb00162a34289c9f4b60073ef2633cf705b2eb9b47
3
+ size 141557760
params_shard_170.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ef7ddba3bdc34160056079f13dc7392b748e7bb1832bcf094dce965a177e685
3
+ size 18350080
params_shard_172.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac4e9c3110a371d5df662b5b1d097f3c84e604a5ac1437df0cb7a1cacd3b512a
3
+ size 70778880
params_shard_174.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cd80ce68b56687eaee0308da2e592c3c3998eaabd1c95c1ed29844dd4a3c13e
3
+ size 25917440
params_shard_177.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62f34d6a8df65b07e7960b660914e016f4db51dbc4cd816ac6471f7adb5a67ca
3
+ size 28860416
params_shard_178.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:626de95aa4f8f4458fd37b96395df5bd14ef4fe70b35eee0cddb0e497de46525
3
+ size 70778880
params_shard_179.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74d93202d0a99d62017fc853af6dc5dab759ffaec56415cb9ece3cda6174d632
3
+ size 141557760
params_shard_187.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6eecd54736c7ee65cfbdbc61a1d33aa7c55aaef1314d0f888f907163f7ce11ea
3
+ size 25921536
params_shard_188.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a89641b5440779d3e301e74c97594f4d3b6747ef69b1ac7ed7f67a482d27fba
3
+ size 70778880
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fface256ac4f59b608dd0d82e713ba9b9fdae95e0cd656be281341fc355ea32
3
+ size 70778880
params_shard_193.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:707a691debebaf826031a4a903a397c06d9ca7a645e2699671fb5df114aed891
3
+ size 70778880
params_shard_196.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0d4a8729d66e1282697c0940a028ba310e6d9553aad6f14159c250dc2d2af74
3
+ size 18350080
params_shard_197.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a236e9b3d215e6fc3411f6ab2564d74c9b89dd4607074f89a4300473074846a
3
+ size 25921536
params_shard_202.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:131148d21fe40d0b08581af6f8fd6d68bd64cdc95c8df9d4649dadaebe4edccc
3
+ size 25921536
params_shard_206.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29d1fa5ff96643682e6476da99a53ec45fdf8fbc6242ae057a1c6a4567b57bdc
3
+ size 18350080
params_shard_212.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9918b45e79e50ff2d1abefcd87c9b32aa06ff71486f5829af131e7f0085ecfa9
3
+ size 25921536
params_shard_213.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f64e973d89f514f26ac5141783f899143a0e5fdace7aa9c8778298012d00f1b
3
+ size 70778880
params_shard_215.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:470b4426b2cbdef859e924c6da929876398f283c117307215dc4ab15c234c9c6
3
+ size 17694720
params_shard_217.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebe5daf72375378a2f72d7716b58348dc1dfbf6bab858d2bf967537685a47f69
3
+ size 25921536
params_shard_22.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9a3f07f57f2019a9b5121dc2f96160791dfe824a188fdb52897927d45a13082
3
+ size 18350080
params_shard_220.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a20b9911670d54582a59b66885820507b89b05d85822ec5d08fc98edd5dc998
3
+ size 32454656
params_shard_222.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a22cb3e6d96037c173f8dfb003fb2ce10654673e6321e8abc4f5d401000d88d
3
+ size 70778880
params_shard_223.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff20b5ce510ef4645a18d790db08f1128bc4b0b75c21c88345c4052f3b5dfdf0
3
+ size 25917440
params_shard_224.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6799c4770b598a6cbcd1cc169d1fcad3bda90e518b9077d0a8ea47f2fcddb1c
3
+ size 141557760
params_shard_227.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66d0aa4e4ae96c79517c2e727d120bd0b18b6aaf181d368c15525277dd607b88
3
+ size 70778880
params_shard_233.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:970a3c010aeb41b91b751b08f0555cab489dc0dc5a82edfbea8ea56107d81752
3
+ size 141557760