Model save

README.md

@@ -0,0 +1,58 @@
+---
+base_model: meta-llama/Meta-Llama-3-8B-Instruct
+library_name: transformers
+model_name: Meta-Llama-3-8B-Instruct_Mixture-of-Thoughts-all-4k-with_reasoning
+tags:
+- generated_from_trainer
+- trl
+- sft
+licence: license
+---
+
+# Model Card for Meta-Llama-3-8B-Instruct_Mixture-of-Thoughts-all-4k-with_reasoning
+
+This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct).
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="CohenQu/Meta-Llama-3-8B-Instruct_Mixture-of-Thoughts-all-4k-with_reasoning", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yuxiao98/uncategorized/runs/02e1s5k9) 
+
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.17.0
+- Transformers: 4.55.2
+- Pytorch: 2.8.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": [
+    128001,
+    128009
+  ],
+  "max_length": 4096,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.55.2"
+}

model-00001-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:49103d15a1bf852295956752463f83bb2815ee94902436087dc968c7328c32fe
+oid sha256:053622f014f2e0ec4828fe6cb61a0747f6a1119c5fb6cbfad67ed38ef03d0336
 size 4886466168

model-00002-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b25ce08c4c2dcc7f58e075a324e15c5d0e36a4999385f399a618811ac46042fc
+oid sha256:2cfd0b4c49a949f6dfaec77a7b3a51a39c2cf5d032d455dc90a5f4ef553059cf
 size 4832007448

model-00003-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1901c633d446f3d877834f496816f4468a6ba14bcd98671d64406c128ed196d3
+oid sha256:d9123f96ae0470283aa804d787c1581f630deebe67b67193e10c3839e79f6017
 size 4999813112

model-00004-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:11e7bb5ca84f1e154ad2502e12f1884e3b73ac42a76bf4c80f57c8b562d636e9
+oid sha256:09a9dac278d05f407f6e6bead3937f9111eb18f1a7936ef50dab495b7b61cbff
 size 4999813128

model-00005-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9f7236a5009efbddd264904879a6d32bd9e546a9e626892f17482efda606ae09
+oid sha256:5ceeea80e8eac279e13c2595bd0b6b1845982dbda86e7265b5fc6e47597a3f1e
 size 4832007496

model-00006-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9272e93a0ec7c869aedaadab73813308bdaa32ad2430a2520dcd757b34a7bf8f
+oid sha256:6664078a39b484e98c33c9c6dcae1355c7fdfe963da30510af330265fe617fbb
 size 4999813120

model-00007-of-00007.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b0b6be50df6ea9f9e161d20e6c6238dcac20ce5f7c564c76eea03b56b442df3c
+oid sha256:9deb3187b50157dfaa63d8c9a05c17a72ce905f5fdac39339a1e326342048b62
 size 2571158184