Hugging Face's logo

A854949
/
qwen2-7b-instruct-amazon-description

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files
xet
Metrics Community
A854949 commited on
Commit
0ac4234
·
verified ·
1 Parent(s): eb285e4

Model save

Browse files
Files changed (5) hide show
  1. README.md +2 -3
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. runs/Nov21_02-04-29_DESKTOP-C6KSACL/events.out.tfevents.1732125870.DESKTOP-C6KSACL.124719.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -44,8 +44,7 @@ The following hyperparameters were used during training:
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
- - num_epochs: 3
48
- - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
@@ -55,6 +54,6 @@ The following hyperparameters were used during training:
55
 
56
  - PEFT 0.13.0
57
  - Transformers 4.45.1
58
- - Pytorch 2.2.0+cu121
59
  - Datasets 3.0.1
60
  - Tokenizers 0.20.3
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
+ - num_epochs: 1
 
48
 
49
  ### Training results
50
 
 
54
 
55
  - PEFT 0.13.0
56
  - Transformers 4.45.1
57
+ - Pytorch 2.5.1+cu124
58
  - Datasets 3.0.1
59
  - Tokenizers 0.20.3
adapter_config.json CHANGED
@@ -20,8 +20,8 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "q_proj",
24
- "v_proj"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
+ "v_proj",
24
+ "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0156c0e821557cabfdba3e8349b08168f6077261f02f42ee099ae46cbe018e85
3
  size 10107280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcda95d1de78aa937c318ddb48d8e01e170a1f93f31d1615b381e37dab4c01e5
3
  size 10107280
runs/Nov21_02-04-29_DESKTOP-C6KSACL/events.out.tfevents.1732125870.DESKTOP-C6KSACL.124719.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e82fba351b34226ee238420e81342424fdc83b6915e42e84e94413f0be67f94
3
+ size 8323
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9801b8692862d43f5536d561346f620fe5ac661bce88dff5ac7c7b40e9d7f3d5
3
  size 5560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cb61262a8097c7bc078bb33557c1b52f11d248a7af6fa7905106963d62ddc63
3
  size 5560