diff --git a/README.md b/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..bc5f30d6632ac0efdc7be2e9095e9e9579af2e33
--- /dev/null
+++ b/README.md
@@ -0,0 +1,199 @@
+---
+library_name: transformers
+tags: []
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
\ No newline at end of file
diff --git a/config.json b/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..e016f16a5eedb83aa7763f4cb5688eb60bc3c074
--- /dev/null
+++ b/config.json
@@ -0,0 +1,36 @@
+{
+  "_name_or_path": "/root/alpaca/lora-llama3-70b-incontext-split1/42/checkpoint-165",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": 128001,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 28672,
+  "max_position_embeddings": 131072,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": {
+    "factor": 8.0,
+    "high_freq_factor": 4.0,
+    "low_freq_factor": 1.0,
+    "original_max_position_embeddings": 8192,
+    "rope_type": "llama3"
+  },
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.46.2",
+  "use_cache": true,
+  "vocab_size": 128256
+}
diff --git a/generation_config.json b/generation_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..388971c09aea49fc18ced89d6e57698c3c65f9da
--- /dev/null
+++ b/generation_config.json
@@ -0,0 +1,9 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": 128001,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.46.2"
+}
diff --git a/model-00001-of-00062.safetensors b/model-00001-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a96107907aba60a87a36d4ae83ede87963d4f4da
--- /dev/null
+++ b/model-00001-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e95905f6712a99b0d3adad80f75419ef707b44be05426fd38d6d6b16d3152cb
+size 4806672984
diff --git a/model-00002-of-00062.safetensors b/model-00002-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..99269a084edd398160b13cdfa246ae070913b190
--- /dev/null
+++ b/model-00002-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bec55df30b500cce8f80cd0afc213d10db87172b976945c5d9cf5cdc44d83afe
+size 4362142864
diff --git a/model-00003-of-00062.safetensors b/model-00003-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..25e29ff735752396caf7d40170946bfe9351e8be
--- /dev/null
+++ b/model-00003-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e84909f8673d1117ddf3d69c1a458821ba98a4f34e9200ce5fa82721c795a5e6
+size 4362142864
diff --git a/model-00004-of-00062.safetensors b/model-00004-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d7187e4f934791a955ca7345960a009268f4e826
--- /dev/null
+++ b/model-00004-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa24c5a4effc20659a37400cd4cf5174634df9bc8e3fad5eb2966e695f352f3b
+size 4966188864
diff --git a/model-00005-of-00062.safetensors b/model-00005-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..363409175fc3eb21c1ccc0f748d3966e8fe7b7dc
--- /dev/null
+++ b/model-00005-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ccff0cfa3b94fdc348fae95a4a9fa36f987df419ed7acc1208f73c18ea3f1b8
+size 4362142864
diff --git a/model-00006-of-00062.safetensors b/model-00006-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0c692444a4d2a18cda337721c0ef70eea7b9b3df
--- /dev/null
+++ b/model-00006-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:871af7cbcce63eb67e80c434771179b4e71ee8d3e4dd40dd82353f7f4809dc63
+size 4362142864
diff --git a/model-00007-of-00062.safetensors b/model-00007-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..2a1b3e817a9b2428464bf7c7d1f9495ad6887df6
--- /dev/null
+++ b/model-00007-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2beaaca55c267bca3aaea245dcbb6786d4ba13f0dd4def900cd04cf696132570
+size 4966188864
diff --git a/model-00008-of-00062.safetensors b/model-00008-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..bac1f900a10d80376fcf84cb47780592a6258a01
--- /dev/null
+++ b/model-00008-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b3076b7c88d6ca88fe4d42f77b202219c1dfafe67bafa79d95a79dcfbda9f0
+size 4362142864
diff --git a/model-00009-of-00062.safetensors b/model-00009-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..487746516a18ba456d43b0062de3e495ab4c4f12
--- /dev/null
+++ b/model-00009-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5caa4eb7692b4243ef4d95acdae4af3dae31ac512b20d9327f5fa517d39188d5
+size 4362142880
diff --git a/model-00010-of-00062.safetensors b/model-00010-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0f17a4cd3c0aa95c7e1cbbab3b1011da9da5d49b
--- /dev/null
+++ b/model-00010-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:68bc6c1a34e4ddda4e61691255f12624fa34032545fa0e94cb2ac54333aa324b
+size 4966188880
diff --git a/model-00011-of-00062.safetensors b/model-00011-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..df6da64ef6ad79179d17c42d07ad1fcb388de61e
--- /dev/null
+++ b/model-00011-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71b2cec8534df3dbe47457fd036dc274c88210399cdcb84ab693cd1ccfd49501
+size 4362142872
diff --git a/model-00012-of-00062.safetensors b/model-00012-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1ca971d88be88b37254eb092c60db086b6956856
--- /dev/null
+++ b/model-00012-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f98e39737908ef53145ca46ff50f35bb51b05bb2032c73a8c512a87ff81fce32
+size 4362142872
diff --git a/model-00013-of-00062.safetensors b/model-00013-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b0c604c570e8b75e630a0bafa939f9d63cf0bb52
--- /dev/null
+++ b/model-00013-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7104c2f924fe59fed79d10a0f4fa6aad15f2a77d987ffb764d6e87f508391949
+size 4966188880
diff --git a/model-00014-of-00062.safetensors b/model-00014-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..afef0a0a1a084237436acec82992b8284467c533
--- /dev/null
+++ b/model-00014-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3722ccc1023581abd5994f59c1515c6ae04552a026f7ad7762774fa3d98157f4
+size 4362142872
diff --git a/model-00015-of-00062.safetensors b/model-00015-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..4e1cfbcba1b0a5a8e35ccfaeb7e72c3b8bab48b4
--- /dev/null
+++ b/model-00015-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83c9476c756d4dd7cb300e8fd768bcf88cfaf84ccff7d77da3cfbff95578879f
+size 4362142872
diff --git a/model-00016-of-00062.safetensors b/model-00016-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..cfca0e5b39dc690a2b192c87a4f801cc64ccb09d
--- /dev/null
+++ b/model-00016-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d1e98ea46de24f1e29703e6fbbd16d25a6985c9638a11c550da33bcf6ad0ef3c
+size 4966188880
diff --git a/model-00017-of-00062.safetensors b/model-00017-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..8e784415993e2f858e17a74ff333e1db45abb8f8
--- /dev/null
+++ b/model-00017-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a8bc24e9c3b5c1c7b00f56ab09819607479f6095194c013a0f7235c7c46612a
+size 4362142872
diff --git a/model-00018-of-00062.safetensors b/model-00018-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e6e420f07874c6a177a2c6df9ae44602f7bcf023
--- /dev/null
+++ b/model-00018-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2558122b62aa5fe9097c98b39f622a16e948668e9d830b67581ad8ca5526938d
+size 4362142872
diff --git a/model-00019-of-00062.safetensors b/model-00019-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..eb6fa0c9fec6c2f52ddb46151b466f410bf2f5ed
--- /dev/null
+++ b/model-00019-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54fd77b551c2eadbc986014d86175dcdfbd53c9cc83c28b77460685e742e0e9c
+size 4966188880
diff --git a/model-00020-of-00062.safetensors b/model-00020-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..09198a93bfd031c5197755c48cd35bf51aaa4907
--- /dev/null
+++ b/model-00020-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff5f53b0024cae8006b87e00b46ab509ec56f66123711288c842f99f8cd4e051
+size 4362142872
diff --git a/model-00021-of-00062.safetensors b/model-00021-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a54f570f03ad6a5ed4fb365348ea045c79b9b3c4
--- /dev/null
+++ b/model-00021-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9b04563f9464336eb2822a404983e25c4d4639f71e9a9a707339407f92f4b551
+size 4362142872
diff --git a/model-00022-of-00062.safetensors b/model-00022-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..575ced170d048e82b2db2da42000097ee9ce6842
--- /dev/null
+++ b/model-00022-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd9bba26ddccb263655a39edf1940cd4edbc9cdb80b3634c78c6e3359789e532
+size 4966188880
diff --git a/model-00023-of-00062.safetensors b/model-00023-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c6cc837e3a397b93b957e30606139261af87df9e
--- /dev/null
+++ b/model-00023-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:066b447337579ab99b151d32916e638fb15b6159b2e4978069f06bad8d93670a
+size 4362142872
diff --git a/model-00024-of-00062.safetensors b/model-00024-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..1d8fd6d9c9e5457c55f46def34472de383c2202d
--- /dev/null
+++ b/model-00024-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b30e776f72bd290cc590ce8183e98ba4a7c81f68d54087134c4d2ddaa85744a0
+size 4362142872
diff --git a/model-00025-of-00062.safetensors b/model-00025-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..61a829a3cdef09ebd3630db96642f44af3cd6d99
--- /dev/null
+++ b/model-00025-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e40da726b01578d69e2fae2200ed2c7e98b9c1b1f9860569039ccc2136f5519
+size 4966188880
diff --git a/model-00026-of-00062.safetensors b/model-00026-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..05d2551a8a47240c96d01330f8a72939590fdbdb
--- /dev/null
+++ b/model-00026-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f67af56ab6b7c0ce91a0f724df8a2534bd5a950c971541b39650ea864a15e772
+size 4362142872
diff --git a/model-00027-of-00062.safetensors b/model-00027-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b2758ff2d2f9edb649dbef19c255173f5e30f904
--- /dev/null
+++ b/model-00027-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5661c6f7ee240e0eb95e86e4e8ea8126fd73ceb349ec8ee4aa431d0a98f7b092
+size 4362142872
diff --git a/model-00028-of-00062.safetensors b/model-00028-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0897ffca893e7036dbfb0a29106fd054c4e99c00
--- /dev/null
+++ b/model-00028-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9f8a277b704ab1b3d3b06bf7f7e563508cad8adaacaee889752e0ff99ef932d
+size 4966188880
diff --git a/model-00029-of-00062.safetensors b/model-00029-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..93b9d76f92bc6c18fddbc4c6437a242f0dddda60
--- /dev/null
+++ b/model-00029-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c58b445b6c7cd35df1945e4c85bab49dd62cf764ad4f53f3a5e3aade3095f58
+size 4362142872
diff --git a/model-00030-of-00062.safetensors b/model-00030-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0b46b8cb5005c486deb1c8e12cdf500bba8ddbd3
--- /dev/null
+++ b/model-00030-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87e799561c998adc2b879b9f8381096fb768f04ef230889fc20b129daeb5a767
+size 4362142872
diff --git a/model-00031-of-00062.safetensors b/model-00031-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..a441357c3f2f3b5885a7dd4e1ce60c727ce297bb
--- /dev/null
+++ b/model-00031-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:146c5bdd8c7ca1c03aa99513076856b40bbb5215d64c7b509bd2fb95ae5e667b
+size 4966188880
diff --git a/model-00032-of-00062.safetensors b/model-00032-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..e9ea587a7b4b63e956a816ca4cc38ef36237e6a5
--- /dev/null
+++ b/model-00032-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fbc4588ddb94d91dbccb1bc54c06b0e0f03a20b845a30a652965a26230b97c0
+size 4362142872
diff --git a/model-00033-of-00062.safetensors b/model-00033-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..0853b1616e69554e15255e195658e8a93e74a907
--- /dev/null
+++ b/model-00033-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:324bf2775304bfb43fe70e30dadb79f6bd601240abc2a9092d90231e040da5ba
+size 4362142872
diff --git a/model-00034-of-00062.safetensors b/model-00034-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..30893110c7c100185af8a431e2f31c0d611ba458
--- /dev/null
+++ b/model-00034-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0e885373a3acb8700a1ddc5437808994e7a94b3fb2ed920cb5fb05899025c75
+size 4966188880
diff --git a/model-00035-of-00062.safetensors b/model-00035-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..948ddb66494904e47f4b517246b3e9fe75b1d291
--- /dev/null
+++ b/model-00035-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:be1846bbbf634553a19a05b08ce8ee77933bc4898939158628ebd8d34d825d9f
+size 4362142872
diff --git a/model-00036-of-00062.safetensors b/model-00036-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c476a6f610a79fd044c0db80d8cde0a00a9dafed
--- /dev/null
+++ b/model-00036-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8292fdd5a0474b75f4e5debe2831e5c05968784a9934c723a5dab441aad93c38
+size 4362142872
diff --git a/model-00037-of-00062.safetensors b/model-00037-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ac50654bb8cc205c9b433c9c064a452d5fa90f18
--- /dev/null
+++ b/model-00037-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9263bcf17c00061b4c187a233b341b41d2c8b933768d5cdddbdf07983174a246
+size 4966188880
diff --git a/model-00038-of-00062.safetensors b/model-00038-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..cf7faad14f2a2c81a844970e8f83f1731c4f08f6
--- /dev/null
+++ b/model-00038-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea0a7806767f04e3b5f9b6babced8ee9894490e3325a2a12ccea02b9a11e3f2a
+size 4362142872
diff --git a/model-00039-of-00062.safetensors b/model-00039-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..6a5e3eba59315a4e4ae44ec6dbe387bc398c203c
--- /dev/null
+++ b/model-00039-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5971d837bc5b3f4fd7127a3b719fdeb63bba3e49416267a1c1669f9d668916d1
+size 4362142872
diff --git a/model-00040-of-00062.safetensors b/model-00040-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..caeec56ecdf2d730609d485a2b26958154a7b2e5
--- /dev/null
+++ b/model-00040-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:023d7cd10f27600e02538b68f63a50fc7f2100ca641df126349e7dac79d0b0be
+size 4966188880
diff --git a/model-00041-of-00062.safetensors b/model-00041-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..873a6a1bd35a99652d953562d7e9f62556d81bff
--- /dev/null
+++ b/model-00041-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e0c235592606f552ca71f8b05af3c87a3e4e6dac644ff9d741395aeee41eb17
+size 4362142872
diff --git a/model-00042-of-00062.safetensors b/model-00042-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..c7326f980c6cc03a1f4dbc20929a30f6f6562058
--- /dev/null
+++ b/model-00042-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b698536616550e991feb8195ab93172a9e9ed3c3a68831eaac7eca623359fb3d
+size 4362142872
diff --git a/model-00043-of-00062.safetensors b/model-00043-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..aa125cc51897ba46b1dd2316637b5408d1d82d44
--- /dev/null
+++ b/model-00043-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:177cd52eaed575d44ba305ab6fddd7c9fc52843a7f9ea59d531c92c0862a4f09
+size 4966188880
diff --git a/model-00044-of-00062.safetensors b/model-00044-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..f1935a049cff68e0faf1eac45600af9a21f09c8c
--- /dev/null
+++ b/model-00044-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6c496161552694e7dd6dd1f168ac694b01a77492d87c68639b0fcca6a34032e
+size 4362142872
diff --git a/model-00045-of-00062.safetensors b/model-00045-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..67edab34234faaebdf8b29599cc3af72d1f33304
--- /dev/null
+++ b/model-00045-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b99cb116189aa8f558239051bc899090a03ecd060f5c008c1bbdfe19220c5107
+size 4362142872
diff --git a/model-00046-of-00062.safetensors b/model-00046-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7824ee06a879f86b80ac1d75ae08806442c340dd
--- /dev/null
+++ b/model-00046-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:331906fcbb1b38aeb328c350025dd54aa86eea9c8007478f7b7fc5f0f1d93e40
+size 4966188880
diff --git a/model-00047-of-00062.safetensors b/model-00047-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..41779c8271a66f451a4d899fba071fde6199bb23
--- /dev/null
+++ b/model-00047-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16ae0a0f70a529783736e6facd83ced0e4363698ad904bde14019681be93fc49
+size 4362142872
diff --git a/model-00048-of-00062.safetensors b/model-00048-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..7a3149607f1c92978ded08bc4fc8edcce4034bac
--- /dev/null
+++ b/model-00048-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad855d89462dc5ec67b7b56a0e17f0a1f89d0b13c1ec583c95430962bdcb1692
+size 4362142872
diff --git a/model-00049-of-00062.safetensors b/model-00049-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..67007a9f1a139cac9f5939ef2aa1626ab9422f58
--- /dev/null
+++ b/model-00049-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c0be1379f54866089af869b8c55255c94a15dcb767451b5de00566b5846ecad
+size 4966188880
diff --git a/model-00050-of-00062.safetensors b/model-00050-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..b76a54ee7552997bdba3b730280e2811321ede54
--- /dev/null
+++ b/model-00050-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2cf66098703315a23e780a3f498e1402b399d3c026b396111339405f853de99
+size 4362142872
diff --git a/model-00051-of-00062.safetensors b/model-00051-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d298358c3cfa2c722cd553597f575db3d5fe0b1e
--- /dev/null
+++ b/model-00051-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ab8b4270028f7e4b53861f1edfd6e77fbbf17e9d7b382c0179d0c198f6e1387
+size 4362142872
diff --git a/model-00052-of-00062.safetensors b/model-00052-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3c0c8a7063f165b1fae667ff0206f090682e7478
--- /dev/null
+++ b/model-00052-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44eb6539d01b868384a7610ad2322a9f1ab90a4af4fb589c80895dea1923a9d9
+size 4966188880
diff --git a/model-00053-of-00062.safetensors b/model-00053-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..89a4750bd62752e36034df7bfe06d6f1b4547b65
--- /dev/null
+++ b/model-00053-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2aeab882da054ed5ccdda9536bbe2ace9dfe059a6f67c0b2c3477beea632976f
+size 4362142872
diff --git a/model-00054-of-00062.safetensors b/model-00054-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d26b7d409fab2fdcf5e20eed7844657fe9cae32a
--- /dev/null
+++ b/model-00054-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0d5cabfe907fb58b18a48506d9b06d667f403659dc1aa37843e42ea317fbdcd
+size 4362142872
diff --git a/model-00055-of-00062.safetensors b/model-00055-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..d94f386aea2b99e67602c1f0e99bbef3a4cb881a
--- /dev/null
+++ b/model-00055-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9477c50beeb6e75c98d171b3f0ea14cb012adf9228c8ba398fdf18803dd04ce
+size 4966188880
diff --git a/model-00056-of-00062.safetensors b/model-00056-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..72feeaae4438d64ed4c274b441f66e61dac8fad4
--- /dev/null
+++ b/model-00056-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7102ea113bb2d4e61cca145ab45f4fbad57a4de25fd265402d9ef2fe8150f38f
+size 4362142872
diff --git a/model-00057-of-00062.safetensors b/model-00057-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ec622a93002a80c2379c0b3f0997bbf488055ab4
--- /dev/null
+++ b/model-00057-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9edae74cc3faddc186c53d8655499dd4e315824803ca2740bc2d69cad0d5706f
+size 4362142872
diff --git a/model-00058-of-00062.safetensors b/model-00058-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..53ca7179a818a6866d6c563534034d5c1d2a2057
--- /dev/null
+++ b/model-00058-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5a2396f652d52c6d3325a1dd95bf14191dd3442e50ead0bd205b77436f5260a
+size 4966188880
diff --git a/model-00059-of-00062.safetensors b/model-00059-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..fbbe450a6dfa38381e133b5e5923a026cc56d0c2
--- /dev/null
+++ b/model-00059-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55142a9fe804a48398f3fcbe4b6da41f0ae6fc7855e82faf3956ac2f3b63ada3
+size 4362142872
diff --git a/model-00060-of-00062.safetensors b/model-00060-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..34f3744e0a69abf5b1b6251495de09024498359f
--- /dev/null
+++ b/model-00060-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54f85337dab33f17887d0b591425780b80da133576af5baf59c663cf0f082b0a
+size 4362142872
diff --git a/model-00061-of-00062.safetensors b/model-00061-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ae7568967347c26bd5fad9a0740a3a7d81c4dd83
--- /dev/null
+++ b/model-00061-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21f5a9a00a06a305acc960cc3d4c82e2929411bfe7b08551a6c9810a9ddaf325
+size 4362241496
diff --git a/model-00062-of-00062.safetensors b/model-00062-of-00062.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..3ae0bf5a162a1f01091797f92cb56f932a0d0c71
--- /dev/null
+++ b/model-00062-of-00062.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e4016f2c0cfb4accb6a98dccb5b0d6bdb2ed46110de2224d6c6c06e262f5bcb
+size 4202692736
diff --git a/model.safetensors.index.json b/model.safetensors.index.json
new file mode 100644
index 0000000000000000000000000000000000000000..8aab69e95f0d7da106bad45a4e7c35897ecf3d80
--- /dev/null
+++ b/model.safetensors.index.json
@@ -0,0 +1,730 @@
+{
+  "metadata": {
+    "total_size": 282214825984
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00062-of-00062.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00002-of-00062.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00062.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00003-of-00062.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00002-of-00062.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00011-of-00062.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00010-of-00062.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00012-of-00062.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00011-of-00062.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00012-of-00062.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00014-of-00062.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00013-of-00062.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00015-of-00062.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00014-of-00062.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00015-of-00062.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00003-of-00062.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00017-of-00062.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00016-of-00062.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00018-of-00062.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00017-of-00062.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00018-of-00062.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00020-of-00062.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00019-of-00062.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00021-of-00062.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00020-of-00062.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00021-of-00062.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00023-of-00062.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00022-of-00062.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00024-of-00062.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00023-of-00062.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00024-of-00062.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00026-of-00062.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00025-of-00062.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00027-of-00062.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00026-of-00062.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00027-of-00062.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00029-of-00062.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00028-of-00062.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00030-of-00062.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00029-of-00062.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00030-of-00062.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00005-of-00062.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00004-of-00062.safetensors",
+    "model.layers.40.input_layernorm.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.down_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.gate_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.mlp.up_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.post_attention_layernorm.weight": "model-00032-of-00062.safetensors",
+    "model.layers.40.self_attn.k_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.o_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.q_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.40.self_attn.v_proj.weight": "model-00031-of-00062.safetensors",
+    "model.layers.41.input_layernorm.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.mlp.down_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.mlp.gate_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.mlp.up_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.post_attention_layernorm.weight": "model-00033-of-00062.safetensors",
+    "model.layers.41.self_attn.k_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.o_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.q_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.41.self_attn.v_proj.weight": "model-00032-of-00062.safetensors",
+    "model.layers.42.input_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.mlp.down_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.mlp.gate_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.mlp.up_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.post_attention_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.42.self_attn.k_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.o_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.q_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.42.self_attn.v_proj.weight": "model-00033-of-00062.safetensors",
+    "model.layers.43.input_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.down_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.gate_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.mlp.up_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.post_attention_layernorm.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.k_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.o_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.q_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.43.self_attn.v_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.input_layernorm.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.down_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.gate_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.mlp.up_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.post_attention_layernorm.weight": "model-00035-of-00062.safetensors",
+    "model.layers.44.self_attn.k_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.o_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.q_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.44.self_attn.v_proj.weight": "model-00034-of-00062.safetensors",
+    "model.layers.45.input_layernorm.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.mlp.down_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.mlp.gate_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.mlp.up_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.post_attention_layernorm.weight": "model-00036-of-00062.safetensors",
+    "model.layers.45.self_attn.k_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.o_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.q_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.45.self_attn.v_proj.weight": "model-00035-of-00062.safetensors",
+    "model.layers.46.input_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.mlp.down_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.mlp.gate_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.mlp.up_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.post_attention_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.46.self_attn.k_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.o_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.q_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.46.self_attn.v_proj.weight": "model-00036-of-00062.safetensors",
+    "model.layers.47.input_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.down_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.gate_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.mlp.up_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.post_attention_layernorm.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.k_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.o_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.q_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.47.self_attn.v_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.input_layernorm.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.down_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.gate_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.mlp.up_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.post_attention_layernorm.weight": "model-00038-of-00062.safetensors",
+    "model.layers.48.self_attn.k_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.o_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.q_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.48.self_attn.v_proj.weight": "model-00037-of-00062.safetensors",
+    "model.layers.49.input_layernorm.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.mlp.down_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.mlp.gate_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.mlp.up_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.post_attention_layernorm.weight": "model-00039-of-00062.safetensors",
+    "model.layers.49.self_attn.k_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.o_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.q_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.49.self_attn.v_proj.weight": "model-00038-of-00062.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00006-of-00062.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00005-of-00062.safetensors",
+    "model.layers.50.input_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.mlp.down_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.mlp.gate_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.mlp.up_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.post_attention_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.50.self_attn.k_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.o_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.q_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.50.self_attn.v_proj.weight": "model-00039-of-00062.safetensors",
+    "model.layers.51.input_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.down_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.gate_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.mlp.up_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.post_attention_layernorm.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.k_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.o_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.q_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.51.self_attn.v_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.input_layernorm.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.down_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.gate_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.mlp.up_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.post_attention_layernorm.weight": "model-00041-of-00062.safetensors",
+    "model.layers.52.self_attn.k_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.o_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.q_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.52.self_attn.v_proj.weight": "model-00040-of-00062.safetensors",
+    "model.layers.53.input_layernorm.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.mlp.down_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.mlp.gate_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.mlp.up_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.post_attention_layernorm.weight": "model-00042-of-00062.safetensors",
+    "model.layers.53.self_attn.k_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.o_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.q_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.53.self_attn.v_proj.weight": "model-00041-of-00062.safetensors",
+    "model.layers.54.input_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.mlp.down_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.mlp.gate_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.mlp.up_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.post_attention_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.54.self_attn.k_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.o_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.q_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.54.self_attn.v_proj.weight": "model-00042-of-00062.safetensors",
+    "model.layers.55.input_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.down_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.gate_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.mlp.up_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.post_attention_layernorm.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.k_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.o_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.q_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.55.self_attn.v_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.input_layernorm.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.down_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.gate_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.mlp.up_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.post_attention_layernorm.weight": "model-00044-of-00062.safetensors",
+    "model.layers.56.self_attn.k_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.o_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.q_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.56.self_attn.v_proj.weight": "model-00043-of-00062.safetensors",
+    "model.layers.57.input_layernorm.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.mlp.down_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.mlp.gate_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.mlp.up_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.post_attention_layernorm.weight": "model-00045-of-00062.safetensors",
+    "model.layers.57.self_attn.k_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.o_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.q_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.57.self_attn.v_proj.weight": "model-00044-of-00062.safetensors",
+    "model.layers.58.input_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.mlp.down_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.mlp.gate_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.mlp.up_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.post_attention_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.58.self_attn.k_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.o_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.q_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.58.self_attn.v_proj.weight": "model-00045-of-00062.safetensors",
+    "model.layers.59.input_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.down_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.gate_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.mlp.up_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.post_attention_layernorm.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.k_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.o_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.q_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.59.self_attn.v_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00006-of-00062.safetensors",
+    "model.layers.60.input_layernorm.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.down_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.gate_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.mlp.up_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.post_attention_layernorm.weight": "model-00047-of-00062.safetensors",
+    "model.layers.60.self_attn.k_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.o_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.q_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.60.self_attn.v_proj.weight": "model-00046-of-00062.safetensors",
+    "model.layers.61.input_layernorm.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.mlp.down_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.mlp.gate_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.mlp.up_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.post_attention_layernorm.weight": "model-00048-of-00062.safetensors",
+    "model.layers.61.self_attn.k_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.o_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.q_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.61.self_attn.v_proj.weight": "model-00047-of-00062.safetensors",
+    "model.layers.62.input_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.mlp.down_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.mlp.gate_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.mlp.up_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.post_attention_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.62.self_attn.k_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.o_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.q_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.62.self_attn.v_proj.weight": "model-00048-of-00062.safetensors",
+    "model.layers.63.input_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.down_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.gate_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.mlp.up_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.post_attention_layernorm.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.k_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.o_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.q_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.63.self_attn.v_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.input_layernorm.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.down_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.gate_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.mlp.up_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.post_attention_layernorm.weight": "model-00050-of-00062.safetensors",
+    "model.layers.64.self_attn.k_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.o_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.q_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.64.self_attn.v_proj.weight": "model-00049-of-00062.safetensors",
+    "model.layers.65.input_layernorm.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.mlp.down_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.mlp.gate_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.mlp.up_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.post_attention_layernorm.weight": "model-00051-of-00062.safetensors",
+    "model.layers.65.self_attn.k_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.o_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.q_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.65.self_attn.v_proj.weight": "model-00050-of-00062.safetensors",
+    "model.layers.66.input_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.mlp.down_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.mlp.gate_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.mlp.up_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.post_attention_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.66.self_attn.k_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.o_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.q_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.66.self_attn.v_proj.weight": "model-00051-of-00062.safetensors",
+    "model.layers.67.input_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.down_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.gate_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.mlp.up_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.post_attention_layernorm.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.k_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.o_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.q_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.67.self_attn.v_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.input_layernorm.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.down_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.gate_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.mlp.up_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.post_attention_layernorm.weight": "model-00053-of-00062.safetensors",
+    "model.layers.68.self_attn.k_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.o_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.q_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.68.self_attn.v_proj.weight": "model-00052-of-00062.safetensors",
+    "model.layers.69.input_layernorm.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.mlp.down_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.mlp.gate_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.mlp.up_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.post_attention_layernorm.weight": "model-00054-of-00062.safetensors",
+    "model.layers.69.self_attn.k_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.o_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.q_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.69.self_attn.v_proj.weight": "model-00053-of-00062.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.70.input_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.mlp.down_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.mlp.gate_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.mlp.up_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.post_attention_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.70.self_attn.k_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.o_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.q_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.70.self_attn.v_proj.weight": "model-00054-of-00062.safetensors",
+    "model.layers.71.input_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.down_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.gate_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.mlp.up_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.post_attention_layernorm.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.k_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.o_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.q_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.71.self_attn.v_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.input_layernorm.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.down_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.gate_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.mlp.up_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.post_attention_layernorm.weight": "model-00056-of-00062.safetensors",
+    "model.layers.72.self_attn.k_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.o_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.q_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.72.self_attn.v_proj.weight": "model-00055-of-00062.safetensors",
+    "model.layers.73.input_layernorm.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.mlp.down_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.mlp.gate_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.mlp.up_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.post_attention_layernorm.weight": "model-00057-of-00062.safetensors",
+    "model.layers.73.self_attn.k_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.o_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.q_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.73.self_attn.v_proj.weight": "model-00056-of-00062.safetensors",
+    "model.layers.74.input_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.mlp.down_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.mlp.gate_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.mlp.up_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.post_attention_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.74.self_attn.k_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.o_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.q_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.74.self_attn.v_proj.weight": "model-00057-of-00062.safetensors",
+    "model.layers.75.input_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.down_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.gate_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.mlp.up_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.post_attention_layernorm.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.k_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.o_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.q_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.75.self_attn.v_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.input_layernorm.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.down_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.gate_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.mlp.up_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.post_attention_layernorm.weight": "model-00059-of-00062.safetensors",
+    "model.layers.76.self_attn.k_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.o_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.q_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.76.self_attn.v_proj.weight": "model-00058-of-00062.safetensors",
+    "model.layers.77.input_layernorm.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.mlp.down_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.mlp.gate_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.mlp.up_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.post_attention_layernorm.weight": "model-00060-of-00062.safetensors",
+    "model.layers.77.self_attn.k_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.o_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.q_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.77.self_attn.v_proj.weight": "model-00059-of-00062.safetensors",
+    "model.layers.78.input_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.mlp.down_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.mlp.gate_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.mlp.up_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.post_attention_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.78.self_attn.k_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.o_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.q_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.78.self_attn.v_proj.weight": "model-00060-of-00062.safetensors",
+    "model.layers.79.input_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.down_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.gate_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.mlp.up_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.post_attention_layernorm.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.k_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.o_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.q_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.79.self_attn.v_proj.weight": "model-00061-of-00062.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00008-of-00062.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00007-of-00062.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00009-of-00062.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00008-of-00062.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00008-of-00062.safetensors",
+    "model.norm.weight": "model-00061-of-00062.safetensors"
+  }
+}