DavidAU commited on
Commit
eeaab47
·
verified ·
1 Parent(s): ab86131

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -50
README.md DELETED
@@ -1,50 +0,0 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Qwen2.5-MsNext-Instruct-14B-pass-75-75
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the Passthrough merge method.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * d:/Qwen2.5-Coder-14B-Instruct
22
- * d:/MS-Qwen2.5-NextCoder-14B
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- #
30
- # compress to 28 layers from 40 layers.
31
- # Scale to 48 layers
32
- #
33
-
34
- slices:
35
- - sources:
36
- - model: d:/Qwen2.5-Coder-14B-Instruct
37
- layer_range: [0, 18]
38
- - sources:
39
- - model: d:/MS-Qwen2.5-NextCoder-14B
40
- layer_range: [10, 27]
41
- - sources:
42
- - model: d:/Qwen2.5-Coder-14B-Instruct
43
- layer_range: [19, 37]
44
- - sources:
45
- - model: d:/MS-Qwen2.5-NextCoder-14B
46
- layer_range: [28, 48]
47
-
48
- merge_method: passthrough
49
- dtype: float32
50
- ```