Hugging Face's logo

deb101
/
mistral-7b-instruct-v0.3-mimic4-adapt-l2r

Transformers
Safetensors
ltr_model
Generated from Trainer
4-bit precision
bitsandbytes
Model card Files
xet
Community
deb101 commited on
Commit
5b02b14
·
verified ·
1 Parent(s): d28ddf1

Model save

Browse files
Files changed (7) hide show
  1. README.md +9 -9
  2. config.json +3 -2
  3. eval_loss_plot.png +0 -0
  4. eval_ndcg@25_plot.png +0 -0
  5. model.safetensors +1 -1
  6. train_loss_plot.png +0 -0
  7. training_args.bin +1 -1
README.md CHANGED
@@ -16,10 +16,10 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: -438158728757996992.0000
20
- - Ndcg: 0.9571
21
- - Ndcg@25: 0.8843
22
- - Precision@25: 0.9634
23
 
24
  ## Model description
25
 
@@ -53,11 +53,11 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Ndcg | Ndcg@25 | Precision@25 |
55
  |:-------------------------:|:------:|:----:|:------------------------:|:------:|:-------:|:------------:|
56
- | -1114019463802178816.0000 | 1.0 | 44 | -109312091402722160.0000 | 0.9555 | 0.2112 | 0.0 |
57
- | -97186389406882208.0000 | 2.0 | 88 | -332415755916448320.0000 | 0.9562 | 0.7834 | 0.5920 |
58
- | -1330305825467111936.0000 | 3.0 | 132 | -391117015460168128.0000 | 0.9569 | 0.8217 | 0.9086 |
59
- | -355019110469337088.0000 | 4.0 | 176 | -415820224368131648.0000 | 0.9570 | 0.8829 | 0.9360 |
60
- | -4554729996694637568.0000 | 4.9017 | 215 | -438158728757996992.0000 | 0.9571 | 0.8843 | 0.9634 |
61
 
62
 
63
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: -443630515076000256.0000
20
+ - Ndcg: 0.9572
21
+ - Ndcg@25: 0.8320
22
+ - Precision@25: 0.9131
23
 
24
  ## Model description
25
 
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Ndcg | Ndcg@25 | Precision@25 |
55
  |:-------------------------:|:------:|:----:|:------------------------:|:------:|:-------:|:------------:|
56
+ | -820244910218569344.0000 | 1.0 | 44 | -138641363343365152.0000 | 0.9556 | 0.1965 | 0.0 |
57
+ | -92176210412856928.0000 | 2.0 | 88 | -325691602546540992.0000 | 0.9565 | 0.6500 | 0.5451 |
58
+ | -1386633586255750656.0000 | 3.0 | 132 | -437409861527509376.0000 | 0.9569 | 0.7879 | 0.9086 |
59
+ | -352078631547594368.0000 | 4.0 | 176 | -441613587243874944.0000 | 0.9572 | 0.8426 | 0.9143 |
60
+ | -4554006957848212480.0000 | 4.9017 | 215 | -443630515076000256.0000 | 0.9572 | 0.8320 | 0.9131 |
61
 
62
 
63
  ### Framework versions
config.json CHANGED
@@ -1,7 +1,8 @@
1
  {
 
2
  "_name_or_path": "mistralai/Mistral-7B-Instruct-v0.3",
3
  "architectures": [
4
- "LTRModel"
5
  ],
6
  "attention_dropout": 0.0,
7
  "bos_token_id": 1,
@@ -15925,7 +15926,7 @@
15925
  "rope_theta": 1000000.0,
15926
  "sliding_window": null,
15927
  "tie_word_embeddings": false,
15928
- "torch_dtype": "float32",
15929
  "transformers_version": "4.49.0",
15930
  "use_cache": true,
15931
  "vocab_size": 32768
 
1
  {
2
+ "_attn_implementation_autoset": true,
3
  "_name_or_path": "mistralai/Mistral-7B-Instruct-v0.3",
4
  "architectures": [
5
+ "MistralForCausalLM"
6
  ],
7
  "attention_dropout": 0.0,
8
  "bos_token_id": 1,
 
15926
  "rope_theta": 1000000.0,
15927
  "sliding_window": null,
15928
  "tie_word_embeddings": false,
15929
+ "torch_dtype": "bfloat16",
15930
  "transformers_version": "4.49.0",
15931
  "use_cache": true,
15932
  "vocab_size": 32768
eval_loss_plot.png CHANGED
eval_ndcg@25_plot.png CHANGED
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:824e8dcfabe8eae13306b90a911c7f499c28893007d76063323f973640afd0c7
3
  size 4323010659
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba745abf89ec37c617c0edad587c2ec0610bc822fb7810ba7cb442d62ccf6c68
3
  size 4323010659
train_loss_plot.png CHANGED
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1fc47b549caf15a57335bc06d3f9bf5336c1c0e7e1b99706a201d3e85dcb710
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3e91ab752e7916d1fffd8d4ea05148c3e99dea53d30d899bf5079e67fa92384
3
  size 5432