Commit History

fix(tokenizer): Sets fim and think tokens to non-special, and removes unk_token.
3670d21
verified

gugarosa commited on

fix(tokenizer_config): Sets fim and think tokens to non-special, and removes unk_token.
f1527a3
verified

gugarosa commited on

fix(special_tokens_map): Removes unk_token.
f580375
verified

gugarosa commited on

chore(root): Adds top_k information even if 50 is already the default.
0f18025

Gustavo de Rosa commited on

Update README.md
d8d3b44
verified

gugarosa commited on

Update README.md
0b70369
verified

gugarosa commited on

Update README.md
73394c6
verified

gugarosa commited on

fix(root): Use a better placement for the "Usage" section. (#5)
459ab9f
verified

gugarosa commited on

chore(root): Adds files.
609962c

gugarosa commited on

initial commit
28857dc
verified

gugarosa commited on