Phi-4-reasoning / tokenizer.json

Commit History

fix(tokenizer): Sets fim and think tokens to non-special, and removes unk_token.
02fcf71
verified

gugarosa commited on

chore(root): Adds files.
5c8c765

gugarosa commited on