HectorHe commited on
Commit
6f285fa
·
verified ·
1 Parent(s): 5b8e024

End of training

Browse files
Files changed (3) hide show
  1. README.md +3 -1
  2. config.json +1 -1
  3. training.log +2 -0
README.md CHANGED
@@ -1,9 +1,11 @@
1
  ---
2
  base_model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct
 
3
  library_name: transformers
4
  model_name: Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
5
  tags:
6
  - generated_from_trainer
 
7
  - trl
8
  - sft
9
  licence: license
@@ -11,7 +13,7 @@ licence: license
11
 
12
  # Model Card for Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
13
 
14
- This model is a fine-tuned version of [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
  base_model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct
3
+ datasets: yentinglin/s1K-1.1-trl-format
4
  library_name: transformers
5
  model_name: Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
6
  tags:
7
  - generated_from_trainer
8
+ - open-r1
9
  - trl
10
  - sft
11
  licence: license
 
13
 
14
  # Model Card for Deepseek-Coder-V2-Lite-13B-Instruct-sft-s1K
15
 
16
+ This model is a fine-tuned version of [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct) on the [yentinglin/s1K-1.1-trl-format](https://huggingface.co/datasets/yentinglin/s1K-1.1-trl-format) dataset.
17
  It has been trained using [TRL](https://github.com/huggingface/trl).
18
 
19
  ## Quick start
config.json CHANGED
@@ -54,7 +54,7 @@
54
  "topk_method": "greedy",
55
  "torch_dtype": "bfloat16",
56
  "transformers_version": "4.52.0.dev0",
57
- "use_cache": false,
58
  "v_head_dim": 128,
59
  "vocab_size": 102400
60
  }
 
54
  "topk_method": "greedy",
55
  "torch_dtype": "bfloat16",
56
  "transformers_version": "4.52.0.dev0",
57
+ "use_cache": true,
58
  "v_head_dim": 128,
59
  "vocab_size": 102400
60
  }
training.log CHANGED
@@ -215,3 +215,5 @@ weight_decay=0.0,
215
  (lm_head): Linear(in_features=2048, out_features=102400, bias=False)
216
  )
217
  2025-08-14 03:40:52 - INFO - __main__ - *** Save model ***
 
 
 
215
  (lm_head): Linear(in_features=2048, out_features=102400, bias=False)
216
  )
217
  2025-08-14 03:40:52 - INFO - __main__ - *** Save model ***
218
+ 2025-08-14 03:52:38 - INFO - __main__ - Model saved to data/DeepSeek-Coder-V2-Lite-Instruct/sft/s1K
219
+ 2025-08-14 03:52:38 - INFO - __main__ - Pushing to hub...