Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Doaneer
/
Truong
like
0
Sleeping
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
main
Truong
/
MMAudio-main
/
transformers
/
utils
/
test_module
/
custom_tokenization.py
Doaneer
Upload 5065 files
e0be88b
verified
2 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
88 Bytes
from
transformers
import
BertTokenizer
class
CustomTokenizer
(
BertTokenizer
):
pass