Hugging Face's logo

thrunlab
/
t5-large_cola_dense_sp0_ar0

Text Classification
Transformers
PyTorch
t5
Generated from Trainer
Eval Results
text-generation-inference
Model card Files
xet
Community
lukeleeai commited on
Commit
572a93e
·
1 Parent(s): 932f777

End of training

Browse files
Files changed (1) hide show
  1. README.md +103 -0
README.md ADDED
@@ -0,0 +1,103 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: t5-large
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - glue
8
+ metrics:
9
+ - accuracy
10
+ model-index:
11
+ - name: t5-large_cola_dense_sp0_ar0
12
+ results:
13
+ - task:
14
+ name: Text Classification
15
+ type: text-classification
16
+ dataset:
17
+ name: glue
18
+ type: glue
19
+ config: cola
20
+ split: validation
21
+ args: cola
22
+ metrics:
23
+ - name: Accuracy
24
+ type: accuracy
25
+ value: 0.0
26
+ ---
27
+
28
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
+ should probably proofread and complete it, then remove this comment. -->
30
+
31
+ # t5-large_cola_dense_sp0_ar0
32
+
33
+ This model is a fine-tuned version of [t5-large](https://huggingface.co/t5-large) on the glue dataset.
34
+ It achieves the following results on the evaluation set:
35
+ - Loss: 4.7159
36
+ - Accuracy: 0.0
37
+
38
+ ## Model description
39
+
40
+ More information needed
41
+
42
+ ## Intended uses & limitations
43
+
44
+ More information needed
45
+
46
+ ## Training and evaluation data
47
+
48
+ More information needed
49
+
50
+ ## Training procedure
51
+
52
+ ### Training hyperparameters
53
+
54
+ The following hyperparameters were used during training:
55
+ - learning_rate: 5e-05
56
+ - train_batch_size: 16
57
+ - eval_batch_size: 32
58
+ - seed: 1
59
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
+ - lr_scheduler_type: linear
61
+ - lr_scheduler_warmup_steps: 20
62
+ - num_epochs: 6
63
+
64
+ ### Training results
65
+
66
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
67
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
68
+ | 0.6148 | 0.05 | 25 | 0.6325 | 0.6913 |
69
+ | 0.4516 | 0.09 | 50 | 0.5597 | 0.6932 |
70
+ | 0.3091 | 0.14 | 75 | 0.6187 | 0.7996 |
71
+ | 0.6072 | 0.19 | 100 | 0.5791 | 0.7776 |
72
+ | 0.4384 | 0.23 | 125 | 0.4396 | 0.8035 |
73
+ | 0.3521 | 0.28 | 150 | 0.4528 | 0.8092 |
74
+ | 0.2873 | 0.33 | 175 | 0.4780 | 0.8169 |
75
+ | 0.2986 | 0.37 | 200 | 0.5905 | 0.7996 |
76
+ | 0.3324 | 0.42 | 225 | 0.4971 | 0.8150 |
77
+ | 0.4326 | 0.47 | 250 | 0.4197 | 0.8265 |
78
+ | 0.3141 | 0.51 | 275 | 0.4582 | 0.8178 |
79
+ | 0.5325 | 0.56 | 300 | 0.4662 | 0.8245 |
80
+ | 0.3367 | 0.61 | 325 | 0.4346 | 0.8217 |
81
+ | 0.3546 | 0.65 | 350 | 0.4180 | 0.8245 |
82
+ | 0.3396 | 0.7 | 375 | 0.3809 | 0.8236 |
83
+ | 0.3023 | 0.75 | 400 | 0.3908 | 0.8245 |
84
+ | 0.3148 | 0.79 | 425 | 0.4312 | 0.8265 |
85
+ | 0.3596 | 0.84 | 450 | 0.3919 | 0.8389 |
86
+ | 0.2059 | 0.89 | 475 | 0.5070 | 0.8322 |
87
+ | 0.4051 | 0.93 | 500 | 0.4253 | 0.8274 |
88
+ | 0.2948 | 0.98 | 525 | 0.4947 | 0.8313 |
89
+ | 0.2357 | 1.03 | 550 | 0.6221 | 0.8188 |
90
+ | 0.3183 | 1.07 | 575 | 0.6693 | 0.8178 |
91
+ | 0.4272 | 1.12 | 600 | 0.5816 | 0.8236 |
92
+ | 0.1839 | 1.17 | 625 | 0.6645 | 0.8207 |
93
+ | 0.3269 | 1.21 | 650 | 0.7249 | 0.8188 |
94
+ | 0.2694 | 1.26 | 675 | 0.5396 | 0.8313 |
95
+ | 0.2222 | 1.31 | 700 | 0.4576 | 0.8245 |
96
+
97
+
98
+ ### Framework versions
99
+
100
+ - Transformers 4.33.2
101
+ - Pytorch 2.0.1+cu117
102
+ - Datasets 2.14.5
103
+ - Tokenizers 0.11.6