Qwen2.5-0.5B-linear-merge / linear_config.yaml
pravdin's picture
Upload folder using huggingface_hub
2df978e verified
raw
history blame contribute delete
209 Bytes
models:
- model: Qwen/Qwen2.5-0.5B-Instruct
parameters:
weight: 0.6
- model: Qwen/Qwen2.5-0.5B
parameters:
weight: 0.4
merge_method: linear
parameters:
normalize: true
dtype: bfloat16