Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-14B-q3f16_1-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
d193930
·
verified ·
1 Parent(s): e8aa602

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_100.bin +3 -0
  4. params_shard_101.bin +3 -0
  5. params_shard_102.bin +3 -0
  6. params_shard_107.bin +3 -0
  7. params_shard_109.bin +3 -0
  8. params_shard_113.bin +3 -0
  9. params_shard_115.bin +3 -0
  10. params_shard_117.bin +3 -0
  11. params_shard_119.bin +3 -0
  12. params_shard_122.bin +3 -0
  13. params_shard_124.bin +3 -0
  14. params_shard_127.bin +3 -0
  15. params_shard_132.bin +3 -0
  16. params_shard_133.bin +3 -0
  17. params_shard_138.bin +3 -0
  18. params_shard_142.bin +3 -0
  19. params_shard_149.bin +3 -0
  20. params_shard_15.bin +3 -0
  21. params_shard_151.bin +3 -0
  22. params_shard_158.bin +3 -0
  23. params_shard_16.bin +3 -0
  24. params_shard_164.bin +3 -0
  25. params_shard_165.bin +3 -0
  26. params_shard_17.bin +3 -0
  27. params_shard_18.bin +3 -0
  28. params_shard_20.bin +3 -0
  29. params_shard_3.bin +3 -0
  30. params_shard_4.bin +3 -0
  31. params_shard_40.bin +3 -0
  32. params_shard_41.bin +3 -0
  33. params_shard_49.bin +3 -0
  34. params_shard_54.bin +3 -0
  35. params_shard_59.bin +3 -0
  36. params_shard_64.bin +3 -0
  37. params_shard_65.bin +3 -0
  38. params_shard_68.bin +3 -0
  39. params_shard_69.bin +3 -0
  40. params_shard_73.bin +3 -0
  41. params_shard_78.bin +3 -0
  42. params_shard_79.bin +3 -0
  43. params_shard_8.bin +3 -0
  44. params_shard_81.bin +3 -0
  45. params_shard_82.bin +3 -0
  46. params_shard_85.bin +3 -0
  47. params_shard_86.bin +3 -0
  48. params_shard_90.bin +3 -0
  49. params_shard_93.bin +3 -0
  50. params_shard_94.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-14B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-14B-q3f16_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-14B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-14B) model in MLC format `q3f16_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q3f16_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q3f16_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q3f16_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3111981e9e94ec39c2bfe881b2cb36c71299decce05fe5af4e142bde6bd0aacc
3
+ size 23617536
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab729ae0ce9b772aaaf6ad970cc775cb902258c21f7199e2b909142d2233ef9c
3
+ size 28344320
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0682b03b8fe9d300c1f41d2bbf8d7d2e0b697a6e1cc4aea9cab7187b7c7a6342
3
+ size 56623104
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bb1c66b48b7ccc34cd62025de3a0761c5fcb27bf4d135246611e562867f62c7
3
+ size 23617536
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8ee3fb7ca135f7f1774f58af1f5695bc15fe2341826292850139fe1a34a83b0
3
+ size 56623104
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb27af54d1b42d85a283d37e26b450e15f6d4c9b80cf833235de1458e1a89e5d
3
+ size 28344320
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7fdd510a79cf2fcf79b964f2e27964907b4bfcf3b7d43f6e7e9bf68a2c11cdc
3
+ size 31864832
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4ef3c6e4ebda6cb237cf956494ce4fbfc320cc8f7464ad8f5d5bfbea95fa15c
3
+ size 28344320
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4fa7f722fbe8233cb84d9baf09082ce68f88268f9b8af29428c3970a9abfc33
3
+ size 22452224
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18d603f1428f6a9cbedf8fc648f18b5d1c5fe62ac6ae63742a2beff964c63696
3
+ size 31864832
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:578bcbe1afe133735744524cc62e615e36e45361b8846a0f0203f8531b2d5146
3
+ size 28344320
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fba8c217e6019209da9a7aa431a3842b70fbc357109ece1b6d59fea0d6b25e17
3
+ size 28344320
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d034aad160bcecaf63db89b9fc7d5d97edd9bb96fe0565fc5e74eb689072f278
3
+ size 56623104
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72efa158e5cb6f3606ff96ed9839118ee20b6caff4adbef67fd4ccabf7ced631
3
+ size 22452224
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:514b016f874db1d05221d050af2fca2202f53933eefcd4fd60d958f97b728de1
3
+ size 28344320
params_shard_142.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b04c18e39fab927f5ca9c4d6ce4bbc595ae9699b2dbba415ad5713bc926f850
3
+ size 56623104
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4093697198118a58c2298f07f4d55d6dba3760d48d3ac86ab5102a2e0bea7fcf
3
+ size 56623104
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6371e9a132871ab079300af9ca86a3ed1b15103f5e66e4377566f7d114a5ada9
3
+ size 56623104
params_shard_151.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0599c3e1e7ad65ee81545c905ca0bf9a5d063aaae8bd8571edcc1f05ac14f7bb
3
+ size 23617536
params_shard_158.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:110ae00618be2353d99dac0461c63753df9452a21a9d0de3d27167ab9f348e4e
3
+ size 23617536
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7919f917903bfa6209bda396772724c3de229af52f3d58847a8a5e0b39cc898f
3
+ size 22452224
params_shard_164.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:769115553fbdad45d3cb1bc329e9b8d8f83aae29c5b3151d3d4a83e21f7794cf
3
+ size 31864832
params_shard_165.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d6377c843b588c508d05f4a00bc77d309b99af4c9bdc3f9720086276cee8217
3
+ size 23617536
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d08539c4a9a6eafc619215f594d7c89a8780c9c499b4b08da5be483ccf8daa9f
3
+ size 28344320
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:200ca1137b4f3ccb23121f7ddf554aa64569376a766bc2c84fe937bcfa56ca67
3
+ size 56623104
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed0381016705b3c75713d841f3740492c0452d639c9843888c50ef32a53e70c3
3
+ size 23617536
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:683d163376d7b0abe20db3891ad2f79000d85680dbf5683b81643646b689c927
3
+ size 31897600
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:755af847ab3534bc97eb27b9836d5ba2cea3a48bbeb354420e1bdb1676ad4ffb
3
+ size 28344320
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25ed319d237ff6cfb1b264c59295d33a360ce0f1ac66a7ff084be099524faefc
3
+ size 31864832
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae0bf3509dc13894057fab640d076efe9c923e180dc49cda32573ad1ccca4b13
3
+ size 23617536
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32c1889eb4de255bc7271c149694f2ea89eabe3e7d31df805e504917ee95cdac
3
+ size 28344320
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f26530393c48ed8e9fa382b9dafbc17a177267cd9889eb47dbbd5960ead1423e
3
+ size 28344320
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:788ea0a1a0162db8af9dcdf78063e47f1e94d20128066a60c9c11f1caa866f39
3
+ size 56623104
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:086135c31f1727de5bf4aea620b66423cd181adfc680cd51205d9f5ce4a29a06
3
+ size 23617536
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c44ba67fd0087b10f56f30d51db07ecd4fa2a7e42c8fb121237f0c5fba8fc06f
3
+ size 28344320
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa2fe8c69907a581ce75dcbf2f602a895ed5bb1e385c8d8b199c2c4fec472b50
3
+ size 28344320
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:898fb72e412602f2f811d8f17cc4a5d15432f36dac426ee9c71abe7b6a7f71fb
3
+ size 56623104
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:145fa49287fcea8a9f3eeb7bea20a82da1e03eb3bd6505302d0227b68640f87f
3
+ size 56623104
params_shard_78.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7d16203590e73c983c98053e6224ebb2ef2b037a2420279c9ea7029b12ad724
3
+ size 23617536
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f55ade2df0a61743901d6fcbfc8062da91b01d1c1d4c61a8276ea563ee3d335
3
+ size 28325888
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f37aa42ab3c54145474d2e8b2e27291240c976a43dfd258912822e066fe21cb3
3
+ size 56623104
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7770ec12623239a117fcd3c89b4b4bb88933705f7e523c05c24c76feec5f9a6
3
+ size 56623104
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c14aa72c5a098bafbcb343f9f0cb3116dd83c4d4c5916d9334b594e5d9c35f18
3
+ size 22452224
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c94c65785bbd9019b05f7fcfc7b201e592d58597bab242dd3727b61831f49bf2
3
+ size 31864832
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80f04a2a5ce0bdc985fa9582bf4e3c0b40388f476022d9a3f06dfc5d2b1d0fa1
3
+ size 23617536
params_shard_90.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58b9e2f57710e64cd2111b1e2c000e65b94e5a3ed2a60181a6ea058db6ea305d
3
+ size 28344320
params_shard_93.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47878acedacbb054658b7623d365d9ab3969b96eb4de2c915d75b5c5269e43a1
3
+ size 23617536
params_shard_94.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db9386c4aac370e2e39270e899b9a9ccd83cb51ee8bff183311a86a177a4cf10
3
+ size 28344320