DavidAU commited on
Commit
75d894c
·
verified ·
1 Parent(s): 3b5ce51

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -12
README.md CHANGED
@@ -26,20 +26,12 @@ tags:
26
  library_name: transformers
27
  ---
28
 
29
- <font color="red">There is an issue with secondary / remote quantization (gguf) that affect SPECIFIC "Cuda" runtimes currently.
30
- Use "general" Cuda runtime rather than version specific.
31
 
32
- Locally built GGUFs (download source/quant) and MLX quants are working; and not affected by this issue.
33
 
34
- Uploading new re-built source at separate repo to see if this issue can be fixed.
35
-
36
- Mradermacher quants work/check out when using "General Cuda" runtime as noted.
37
-
38
- Extra special thanks to team Mradermacher for tirelessly working with me to root out this issue.
39
-
40
- Other GGUF users / not using Nvidia GPUs should not be affected by this issue.
41
-
42
- Versions with context of 64k, 128k and 192k context will be held back pending new source/upload and testing.
43
  </font>
44
 
45
  <h2>Qwen2.5-2X32B-CoderInstruct-OlympicCoder-87B-V1.1</h2>
 
26
  library_name: transformers
27
  ---
28
 
29
+ <font color="red">There is an issue GGUFs that affect SPECIFIC "Cuda" runtimes currently.
30
+ Use "general" Cuda runtime rather than "version specific" if you get "GIBBISH" output.
31
 
32
+ Currently investigating this.
33
 
34
+ Versions with context of 64k, 128k and 192k context pending...
 
 
 
 
 
 
 
 
35
  </font>
36
 
37
  <h2>Qwen2.5-2X32B-CoderInstruct-OlympicCoder-87B-V1.1</h2>