Update README.md
Browse files
README.md
CHANGED
@@ -26,20 +26,12 @@ tags:
|
|
26 |
library_name: transformers
|
27 |
---
|
28 |
|
29 |
-
<font color="red">There is an issue
|
30 |
-
Use "general" Cuda runtime rather than version specific.
|
31 |
|
32 |
-
|
33 |
|
34 |
-
|
35 |
-
|
36 |
-
Mradermacher quants work/check out when using "General Cuda" runtime as noted.
|
37 |
-
|
38 |
-
Extra special thanks to team Mradermacher for tirelessly working with me to root out this issue.
|
39 |
-
|
40 |
-
Other GGUF users / not using Nvidia GPUs should not be affected by this issue.
|
41 |
-
|
42 |
-
Versions with context of 64k, 128k and 192k context will be held back pending new source/upload and testing.
|
43 |
</font>
|
44 |
|
45 |
<h2>Qwen2.5-2X32B-CoderInstruct-OlympicCoder-87B-V1.1</h2>
|
|
|
26 |
library_name: transformers
|
27 |
---
|
28 |
|
29 |
+
<font color="red">There is an issue GGUFs that affect SPECIFIC "Cuda" runtimes currently.
|
30 |
+
Use "general" Cuda runtime rather than "version specific" if you get "GIBBISH" output.
|
31 |
|
32 |
+
Currently investigating this.
|
33 |
|
34 |
+
Versions with context of 64k, 128k and 192k context pending...
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
</font>
|
36 |
|
37 |
<h2>Qwen2.5-2X32B-CoderInstruct-OlympicCoder-87B-V1.1</h2>
|