Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
gsaltintas
/
tokenizer-comparison
like
0
Running
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
c02e89e
tokenizer-comparison
Ctrl+K
Ctrl+K
2 contributors
History:
5 commits
Gül Sena Altıntaş
Refactoring, and visual improvements
c02e89e
about 1 month ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 month ago
.gitignore
Safe
43 Bytes
Refactoring, and visual improvements
about 1 month ago
README.md
Safe
263 Bytes
initial commit
about 1 month ago
app.py
Safe
17.4 kB
Refactoring, and visual improvements
about 1 month ago
mappings.py
Safe
1.67 kB
Refactoring, and visual improvements
about 1 month ago
requirements.txt
Safe
48 Bytes
Added additional tokenizers
about 1 month ago
utils.py
Safe
4.45 kB
Refactoring, and visual improvements
about 1 month ago