Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

aayushraina
/
bpe-hindi

Text Generation
Hindi
hindi
tokenizer
bpe
subword
text-processing
text2text-generation
Model card Files Files and versions
xet
Community
bpe-hindi
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
aayushraina's picture
aayushraina
Upload 4 files
30325e1 verified 7 months ago
  • tokenizer
    Upload 2 files 7 months ago
  • .gitattributes
    1.52 kB
    initial commit 7 months ago
  • README.md
    2.91 kB
    Upload 4 files 7 months ago
  • app.py
    4.22 kB
    Upload 4 files 7 months ago
  • app_gradio.py
    4.08 kB
    Upload 4 files 7 months ago
  • byte_pair_encoder.py
    8.03 kB
    Upload 9 files 7 months ago
  • data_loader.py
    4.26 kB
    Upload 9 files 7 months ago
  • download_dataset.py
    6.47 kB
    Upload 9 files 7 months ago
  • encoder.json
    540 kB
    Upload 9 files 7 months ago
  • hindi_bpe.py
    4.56 kB
    Upload 9 files 7 months ago
  • requirements.txt
    149 Bytes
    Upload 4 files 7 months ago
  • test_hindi_bpe.py
    5.78 kB
    Upload 9 files 7 months ago
  • tokenizer_config.json
    359 Bytes
    Upload tokenizer_config.json 7 months ago
  • vocab_stats.json
    474 kB
    Upload 9 files 7 months ago