| license: apache-2.0 | |
| language: | |
| - de | |
| - fr | |
| - en | |
| - ro | |
| base_model: | |
| - google/flan-t5-xxl | |
| Original Model: https://huggingface.co/google/flan-t5-xxl/ | |
| Original Readme: https://huggingface.co/google/flan-t5-xxl/blob/main/README.md | |
| Disclaimer: I don't claim any rights on this modell. All rights go to google. | |
| How to use: | |
| ./llama-cli -m /path/to/file.gguf --prompt "your prompt" --n-gpu-layers nn | |
| nn --> numbers of layers to offload to gpu | |