jamescallander
/

Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation

text-generation-inference

Model card Files Files and versions

jamescallander commited on 18 days ago

Commit

b0f5750

·

verified ·

1 Parent(s): b3c52ee

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -31,6 +31,7 @@ tags:
 - Python: 3.12
 - Quantization: `w8a8_g128`
 - Output: single-file `.rkllm` artifact
 - Tokenizer: not required at runtime (UI handles prompt I/O)
 ## ⚠️ Code generation disclaimer

 - Python: 3.12
 - Quantization: `w8a8_g128`
 - Output: single-file `.rkllm` artifact
+- Modifications: quantization (w8a8_g128), export to .rkllm format for RK3588 SBCs.
 - Tokenizer: not required at runtime (UI handles prompt I/O)
 ## ⚠️ Code generation disclaimer