Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-32B-q0f16-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
8510756
·
verified ·
1 Parent(s): 475ae3a

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_0.bin +3 -0
  4. params_shard_102.bin +3 -0
  5. params_shard_103.bin +3 -0
  6. params_shard_107.bin +3 -0
  7. params_shard_108.bin +3 -0
  8. params_shard_111.bin +3 -0
  9. params_shard_114.bin +3 -0
  10. params_shard_115.bin +3 -0
  11. params_shard_117.bin +3 -0
  12. params_shard_121.bin +3 -0
  13. params_shard_122.bin +3 -0
  14. params_shard_127.bin +3 -0
  15. params_shard_129.bin +3 -0
  16. params_shard_131.bin +3 -0
  17. params_shard_133.bin +3 -0
  18. params_shard_135.bin +3 -0
  19. params_shard_139.bin +3 -0
  20. params_shard_14.bin +3 -0
  21. params_shard_140.bin +3 -0
  22. params_shard_141.bin +3 -0
  23. params_shard_143.bin +3 -0
  24. params_shard_146.bin +3 -0
  25. params_shard_147.bin +3 -0
  26. params_shard_149.bin +3 -0
  27. params_shard_155.bin +3 -0
  28. params_shard_158.bin +3 -0
  29. params_shard_16.bin +3 -0
  30. params_shard_165.bin +3 -0
  31. params_shard_168.bin +3 -0
  32. params_shard_177.bin +3 -0
  33. params_shard_179.bin +3 -0
  34. params_shard_18.bin +3 -0
  35. params_shard_180.bin +3 -0
  36. params_shard_182.bin +3 -0
  37. params_shard_19.bin +3 -0
  38. params_shard_191.bin +3 -0
  39. params_shard_192.bin +3 -0
  40. params_shard_193.bin +3 -0
  41. params_shard_196.bin +3 -0
  42. params_shard_198.bin +3 -0
  43. params_shard_202.bin +3 -0
  44. params_shard_205.bin +3 -0
  45. params_shard_211.bin +3 -0
  46. params_shard_212.bin +3 -0
  47. params_shard_214.bin +3 -0
  48. params_shard_215.bin +3 -0
  49. params_shard_217.bin +3 -0
  50. params_shard_223.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-32B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-32B-q0f16-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-32B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-32B) model in MLC format `q0f16`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f16-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f16-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-32B-q0f16-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f75e33fc0bf782dd98427f8e6b93976e0ba5ee6cf0312aaa3bbae638aea641d6
3
+ size 1557135360
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5022928ae3f135fadaaf0dfb12c3d8de00099f8e27cce45f0356c00d9096282
3
+ size 73400320
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b67cdc1778b2f1889a79181fff9e86a7dedaa691567f48bb1f8dae9c291681e8
3
+ size 52428800
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57c7b0f7625515e36bb2df06f612961bd7627874e0712c18761209c4b8ccc68d
3
+ size 52428800
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f27b527ea33a37785a3a36305599aec5ef8e08364a0fcf28b2edb3470d8ac81
3
+ size 283115520
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c65fc3749d865d27165d396a8b96c49e70ae53b80780efa0e95391524728cece
3
+ size 52428800
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3f4adc2b58a9ef564d27f8ee3924368a376f6f11133da307bd50f75582e66f9
3
+ size 73400320
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e05242312e460a49907649518243e8b60e5cdd0008358c7cfbdd4b877bcaf719
3
+ size 52428800
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7177bf3e3456ef89cc6fced6ac318c4b848fd626745c7a5f075bb8f9419dbcb0
3
+ size 566231040
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7c3594417d83e248296fe96efb18aca80b46815a8d0b3ce828e6c1218a953ec
3
+ size 566231040
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b34c6dc714d6581cf7b865c5669b2241e25513ab6cae8de9dd151c891af66b02
3
+ size 73400320
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f711c4e34ba90aa040ebe3c51ba06be9fa51e8074ce45ff97d242e82b3325e9
3
+ size 52428800
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67d9fcc8df558dcd18bc1542461823456496e423f1dee79237745af336934abc
3
+ size 566231040
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8feb1bc9432a65ae82a27339e26de98463045a5ad6f8bc3ec8a45c5506fd3327
3
+ size 52428800
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62e595863afc3d987fe9a1c10c46a384b8d32955f230f1d949542570a183229f
3
+ size 566231040
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9e6caa45881047983c9393912d4d3160b83e9388bcafe3096a7da38cf76e94f
3
+ size 52428800
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d70c7e7aa9e45cf7c1975520cf02353bdd9ae863a6e07f7447565d3e8b6a6dd
3
+ size 283115520
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af12979477a0ee9a0a9b9035e33c919a9a923374e96403082442c703ed6ad88a
3
+ size 52428800
params_shard_140.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:010742d39f79759f1141a2269aeafd9d4efa3ec1b2c49eaab4b960f64ef8087a
3
+ size 283115520
params_shard_141.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de62984bb1fcf7d8376673839dfa5e3afd3761872213a540ebccb2ac3087cec9
3
+ size 566231040
params_shard_143.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9130c1abc9b67e6391a8b9c63b8e9cb1884543762008a037b69a9415c6e9e686
3
+ size 52428800
params_shard_146.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0be2b34df32f95cc994ae976490b67279b44a3eeef44114746349905343a725d
3
+ size 73400320
params_shard_147.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:475a67353b6b3c87e2bcf8905d0f159cc9351c90ed82ea35a838f6b85a28a82a
3
+ size 52428800
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdd2046ca0aec03608aea4cef1cf139277247c8dbbd3c9c2459b08b339cb1830
3
+ size 566231040
params_shard_155.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:257559ec941434460a09c096fdb289c4a5039de56ccfb68e8d96df7d03ed4fad
3
+ size 52428800
params_shard_158.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc394ca7e742239e05a3b70612e575efed71fc3fa97ccf3a87a6ecc2407c0b7e
3
+ size 73400320
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd59e59a03d10821d830f24439fd3fc1771d642483444f3492bb618fbc78bd28
3
+ size 566231040
params_shard_165.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bf1ca45ba716158348cb2e7ae13f27b6af65b2934afa0ba4fa4e9a60ad76b76
3
+ size 566231040
params_shard_168.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc3db2395ee3e9efd611a321ff2d350ad7c5536aba315a6e7b96f16d27d60d11
3
+ size 283115520
params_shard_177.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb2301008d7c95c11ea06c9fb646d38471b62f4ca7579faa1833a7598d03c35e
3
+ size 73400320
params_shard_179.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df803dee26d20511abb88e43457501eee82e7435deda863e5989cff132b4dfa2
3
+ size 283115520
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:397070d5f1998bdee3a9c0a609064b459fb47ca84fa54be632ebcb6562b037ed
3
+ size 52428800
params_shard_180.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83b5ad3ce1d001f6c231850acced1d8fb6e4f5033edd7ebdf33cc725aceb8cb8
3
+ size 283115520
params_shard_182.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32f354bb5127fed9b43ac9466d628a746c8371dc9a4b0e6eec6126bf799b4d61
3
+ size 73400320
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:967c33c852188691b1f3e3b9e4e89c50a54ce7c1494e4bddf2bb3cca106c6ac2
3
+ size 283115520
params_shard_191.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4fceeb2ffe87a1fd292ba6e548a757c50ccc9582400fedebed9ed99cd4308ed
3
+ size 52428800
params_shard_192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b8c696e9ce8af8787ccb9b5934bf426e6e0625d6507666628b582dd2d68a7bc
3
+ size 283115520
params_shard_193.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f3db04b999b699f2b320261e03ff272b4d4d6adfb305baf31206df7ee3e6d7d
3
+ size 566231040
params_shard_196.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b8216c1a7474343450dd43c0f65484982c925988164bf084b0b21d88318742b
3
+ size 283115520
params_shard_198.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95d2e639889b60826d1585cb41174baad5f3d80310c0593c406bb352105bd466
3
+ size 73400320
params_shard_202.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:796ff0e482e20abef91abd1f7eea39efe18e630c4a0d694bbcc8ca381387e68b
3
+ size 73400320
params_shard_205.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c34b23ebbb010827a8e971905d602000b11ca7c945801d10a44806a55fc381d5
3
+ size 566231040
params_shard_211.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e9888a22244195f13f0699d01de12035e0135bbe5f574b2c10118845f9903c0
3
+ size 52428800
params_shard_212.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:283e5a68afde772123c7da9a81b2dbda14b82c4ff4181141525bf53edde8aef5
3
+ size 283115520
params_shard_214.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a40487925c546f616d379d30b497f5b61e4c30a3dc3c29e6795c1d722e100fc4
3
+ size 73400320
params_shard_215.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:867e03e8bd9ea26429662d86aa792052b68a17262d5cda5573772d035b3546e6
3
+ size 52428800
params_shard_217.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:964e11562745642f2d1dbed864d8594cc09cfe65f69667b7c94232241a6d5102
3
+ size 73400320
params_shard_223.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9bf61cdc69a96a2611eb13d0a0db67feb8ece4ca57c9e4c9f1dfdae9cad6457
3
+ size 52428800