mradermacher
/

very-small-prompt-compression-GGUF

Generated from Trainer

prompt-summarization

prompt-compression

text_summarization

text_compression

Model card Files Files and versions

very-small-prompt-compression-GGUF

587 MB

1 contributor

History: 6 commits

mradermacher's picture

auto-patch README.md

94f8337 verified 18 days ago

.gitattributes

2.45 kB

uploaded from leia 18 days ago
README.md

4.2 kB

auto-patch README.md 18 days ago
very-small-prompt-compression.IQ4_XS.gguf

38 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q2_K.gguf

30.8 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q3_K_L.gguf

38 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q3_K_M.gguf

35.9 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q3_K_S.gguf

33.5 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q4_K_M.gguf

42.1 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q4_K_S.gguf

39.5 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q5_K_M.gguf

46.3 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q5_K_S.gguf

44.9 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q6_K.gguf

50.7 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.Q8_0.gguf

65.4 MB
xet

uploaded from leia 18 days ago
very-small-prompt-compression.f16.gguf

122 MB
xet

uploaded from leia 18 days ago