webpolis
/

zenos-gpt-j-6B-instruct-4bit

Text Generation

4-bit precision

Model card Files Files and versions

Nicolas Iglesias commited on Oct 12, 2023

Commit

cbc0c57

·

1 Parent(s): ecf5055

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -31,8 +31,8 @@ You can use this model for various natural language processing tasks such as tex
 from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
 # Load the tokenizer and model
-tokenizer = AutoTokenizer.from_pretrained("zenos-gpt-j-6B-alpaca-evol-4bit")
-model = AutoModelForCausalLM.from_pretrained("zenos-gpt-j-6B-alpaca-evol-4bit")
 # Generate text; watch out the padding between [INST] ... [/INST]
 prompt = '[INST] Escribe un poema breve usando cuatro versos [/INST]'

 from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
 # Load the tokenizer and model
+tokenizer = AutoTokenizer.from_pretrained("danderian/zenos-gpt-j-6B-alpaca-evol-4bit")
+model = AutoModelForCausalLM.from_pretrained("danderian/zenos-gpt-j-6B-alpaca-evol-4bit")
 # Generate text; watch out the padding between [INST] ... [/INST]
 prompt = '[INST] Escribe un poema breve usando cuatro versos [/INST]'