Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
Apps with no match
llama.cpp
LM Studio
Jan
Backyard AI
Draw Things
DiffusionBee
Jellybox
RecurseChat
Msty
Sanctum
Invoke
JoyFusion
LocalAI
vLLM
node-llama-cpp
Ollama
TGI
MLX LM
Inference Providers
Inference Providers with no match
Fireworks
Novita
Nebius AI
Together AI
Featherless AI
fal
Cerebras
Nscale
SambaNova
Hyperbolic
Groq
Replicate
Cohere
HF Inference API
Misc
Reset Misc
tokenization
custom_code
Inference Endpoints
Misc with no match
text-generation-inference
Eval Results
Merge
4-bit precision
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
22
Full-text search
Edit filters
Sort: Trending
Active filters:
tokenization
Clear all
aymaralima/deeplima
Updated
May 5, 2024
•
3
gsar78/Greek_Tokenizer
Updated
Aug 5, 2024
•
1
M-AI2/PyAI
Updated
Jul 25, 2024
•
1
microsoft/VidTok
Updated
Apr 5
•
41
Emova-ollm/emova_speech_tokenizer_hf
Feature Extraction
•
Updated
Mar 12
•
86
•
2
metinovadilet/kyrgyz_t5_tokenizer
Updated
Feb 24
microsoft/vidtwin
Updated
Mar 20
•
2
JephteyAdolphe/ht_core_news_sm
Updated
May 1
Hanbaike/kyrgyz_bpe_16000
Updated
May 8
Hanbaike/kyrgyz_bpe_24000
Updated
May 8
Hanbaike/kyrgyz_bpe_32000
Updated
May 8
Hanbaike/kyrgyz_bpe_4000
Updated
May 8
Hanbaike/kyrgyz_bpe_51200
Updated
May 8
Hanbaike/kyrgyz_bpe_8000
Updated
May 8
Hanbaike/kyrgyz_unigram_16000
Updated
May 8
Hanbaike/kyrgyz_unigram_24000
Updated
May 8
Hanbaike/kyrgyz_unigram_32000
Updated
May 8
Hanbaike/kyrgyz_unigram_4000
Updated
May 8
Hanbaike/kyrgyz_unigram_51200
Updated
May 8
Hanbaike/kyrgyz_unigram_8000
Updated
May 8
Hanbaike/kyrgyz_spm_tokenizer
Updated
May 8
Hengzongshu/Chinse_BBPE_Vocab
Text Classification
•
Updated
25 days ago