onnx-community
/

text_summarization-ONNX

Transformers.js

text2text-generation

Model card Files Files and versions

Xenova HF Staff commited on 4 days ago

Commit

faf1ad4

·

verified ·

1 Parent(s): aec5206

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +1 -0

tokenizer.json CHANGED Viewed

@@ -948,6 +948,7 @@
       },
       {
         "type": "Metaspace",
         "replacement": "▁",
         "prepend_scheme": "always",
         "split": true

       },
       {
         "type": "Metaspace",
+        "add_prefix_space": true,
         "replacement": "▁",
         "prepend_scheme": "always",
         "split": true