Spaces:

bayartsogt
/

real-time-tokenizer

Running

App Files Files Community

real-time-tokenizer / requirements.txt

bayartsogt's picture

adding sentencepeice to req file

87c056a almost 2 years ago

history blame contribute delete

36 Bytes

	transformers
	tiktoken
	sentencepiece