llm-jp
/

hf-fast-tokenizer-v22b2

Model card Files Files and versions

hiroshi-matsuda-rit commited on Oct 12, 2023

Commit

8d12b54

·

1 Parent(s): db2da86

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: apache-2.0
 ---
 The Hugging Face fast tokenizer for LLM-jp ABCI challenge 2023.
-The vocab size is 96,868.
 Requirements:
 - transformers>=4.34.0

 ---
 The Hugging Face fast tokenizer for LLM-jp ABCI challenge 2023.
+The vocab size is 96,867.
 Requirements:
 - transformers>=4.34.0