Merge pull request #11 from llm-jp/tokenizer-v2.2

Release ver2.2
llm-jp · Oct 9, 2023 · f0cd49d · f0cd49d
2 parents 9f545a2 + e128f9f
commit f0cd49d
Show file tree

Hide file tree

Showing 6 changed files with 145,461 additions and 3 deletions.
diff --git a/models/ver2/code10K_en20K_ja30K.ver2.2.model b/models/ver2/code10K_en20K_ja30K.ver2.2.model