Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,99 @@ datasets:
|
|
| 8 |
---
|
| 9 |
# CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
|
| 10 |
|
| 11 |
-
CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
# CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
|
| 10 |
|
| 11 |
+
CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
|
| 12 |
+
|
| 13 |
+
[Original model](https://huggingface.co/rizerphe/CodeLlama-function-calling-6320-7b-Instruct-hf)
|
| 14 |
+
|
| 15 |
+
## Examples
|
| 16 |
+
|
| 17 |
+
Prompt example:
|
| 18 |
+
|
| 19 |
+
```
|
| 20 |
+
[INST] <<SYS>>
|
| 21 |
+
<function>Available functions:
|
| 22 |
+
<function>{
|
| 23 |
+
"name": "generate_password",
|
| 24 |
+
"description": "Generate a random password with specified criteria",
|
| 25 |
+
"parameters": {
|
| 26 |
+
"type": "object",
|
| 27 |
+
"properties": {
|
| 28 |
+
"length": {
|
| 29 |
+
"type": "integer",
|
| 30 |
+
"description": "The length of the password"
|
| 31 |
+
},
|
| 32 |
+
"include_numbers": {
|
| 33 |
+
"type": "boolean",
|
| 34 |
+
"description": "Include numbers in the password"
|
| 35 |
+
},
|
| 36 |
+
"include_special_characters": {
|
| 37 |
+
"type": "boolean",
|
| 38 |
+
"description": "Include special characters in the password"
|
| 39 |
+
}
|
| 40 |
+
},
|
| 41 |
+
"required": [
|
| 42 |
+
"length"
|
| 43 |
+
]
|
| 44 |
+
}
|
| 45 |
+
}
|
| 46 |
+
<</SYS>>
|
| 47 |
+
|
| 48 |
+
I need a new password. Can you generate one for me? [/INST]
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
The model then generates (note the leading space):
|
| 52 |
+
|
| 53 |
+
```
|
| 54 |
+
Of course! How long would you like your password to be? And would you like it to include numbers and special characters?
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
If you extend the prompt to be:
|
| 58 |
+
|
| 59 |
+
```
|
| 60 |
+
[INST] <<SYS>>
|
| 61 |
+
<function>Available functions:
|
| 62 |
+
<function>{
|
| 63 |
+
"name": "generate_password",
|
| 64 |
+
"description": "Generate a random password with specified criteria",
|
| 65 |
+
"parameters": {
|
| 66 |
+
"type": "object",
|
| 67 |
+
"properties": {
|
| 68 |
+
"length": {
|
| 69 |
+
"type": "integer",
|
| 70 |
+
"description": "The length of the password"
|
| 71 |
+
},
|
| 72 |
+
"include_numbers": {
|
| 73 |
+
"type": "boolean",
|
| 74 |
+
"description": "Include numbers in the password"
|
| 75 |
+
},
|
| 76 |
+
"include_special_characters": {
|
| 77 |
+
"type": "boolean",
|
| 78 |
+
"description": "Include special characters in the password"
|
| 79 |
+
}
|
| 80 |
+
},
|
| 81 |
+
"required": [
|
| 82 |
+
"length"
|
| 83 |
+
]
|
| 84 |
+
}
|
| 85 |
+
}
|
| 86 |
+
<</SYS>>
|
| 87 |
+
|
| 88 |
+
I need a new password. Can you generate one for me? [/INST] Of course! How long would you like your password to be? And would you like it to include numbers and special characters?</s><s>[INST] I'd like it to be 12 characters long. [/INST]
|
| 89 |
+
```
|
| 90 |
+
|
| 91 |
+
The model will generate (without the leading space):
|
| 92 |
+
|
| 93 |
+
```
|
| 94 |
+
<function>generate_password
|
| 95 |
+
{
|
| 96 |
+
"length": 12
|
| 97 |
+
}
|
| 98 |
+
```
|
| 99 |
+
|
| 100 |
+
It can also answer questions based on a prompt without any functions:
|
| 101 |
+
|
| 102 |
+
```
|
| 103 |
+
[INST] In one sentence, what is a large language model? [/INST] A large language model is a type of artificial intelligence model that is trained on vast amounts of text data to generate human-like language and understand natural language input. [/INST] That's correct! Large language models are trained on large datasets of text to generate human-like language and understand natural language input. They are often used in applications such as chatbots, language translation, and text summarization.
|
| 104 |
+
```
|
| 105 |
+
|
| 106 |
+
A quick manual test shows that it's still able to follow a system prompt provided alongside any functions provided, including in multi-turn conversations. None of this was tested comprehensively, though, your results may vary.
|