Mungert
/

granite-3.1-8b-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.1-8b-instruct-GGUF

146 GB

1 contributor

History: 1 commit

Mungert's picture

Super-squash history to reclaim storage

a5b55ac verified about 2 months ago

.gitattributes

4.54 kB

Super-squash history to reclaim storage about 2 months ago
README.md

25.2 kB

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-bf16.gguf

16.3 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-bf16_q8_0.gguf

11.6 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-f16_q8_0.gguf

11.6 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq2_m.gguf

2.94 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq2_s.gguf

2.8 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq2_xs.gguf

2.69 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq2_xxs.gguf

2.46 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq3_m.gguf

3.82 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq3_s.gguf

3.82 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq3_xs.gguf

3.42 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq3_xxs.gguf

3.32 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq4_nl.gguf

4.67 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-iq4_xs.gguf

4.43 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q2_k_m.gguf

3.06 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q2_k_s.gguf

3.03 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q3_k_m.gguf

3.97 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q3_k_s.gguf

3.94 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q4_0.gguf

4.6 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q4_1.gguf

5.11 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q4_k_m.gguf

4.9 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q4_k_s.gguf

4.73 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q5_0.gguf

5.62 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q5_1.gguf

6.13 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q5_k_m.gguf

5.82 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q5_k_s.gguf

5.73 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q6_k_m.gguf

6.71 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct-q8_0.gguf

8.68 GB
xet

Super-squash history to reclaim storage about 2 months ago
granite-3.1-8b-instruct.imatrix

5.99 MB
xet

Super-squash history to reclaim storage about 2 months ago