Mungert
/

granite-4.0-350m-GGUF

Model card Files Files and versions

granite-4.0-350m-GGUF

5.23 GB

1 contributor

History: 21 commits

Mungert's picture

Upload granite-4.0-350m-bf16.gguf with huggingface_hub

b78b72d verified 26 days ago

.gitattributes

2.75 kB

Upload granite-4.0-350m-bf16.gguf with huggingface_hub 26 days ago
README.md

36.9 kB

Upload README.md with huggingface_hub 26 days ago
granite-4.0-350m-bf16.gguf

708 MB
xet

Upload granite-4.0-350m-bf16.gguf with huggingface_hub 26 days ago
granite-4.0-350m-f16_q8_0.gguf

564 MB
xet

Upload granite-4.0-350m-f16_q8_0.gguf with huggingface_hub 26 days ago
granite-4.0-350m-imatrix.gguf

948 kB
xet

Upload granite-4.0-350m-imatrix.gguf with huggingface_hub 26 days ago
granite-4.0-350m-iq3_m.gguf

203 MB
xet

Upload granite-4.0-350m-iq3_m.gguf with huggingface_hub 26 days ago
granite-4.0-350m-iq3_xs.gguf

191 MB
xet

Upload granite-4.0-350m-iq3_xs.gguf with huggingface_hub 26 days ago
granite-4.0-350m-iq3_xxs.gguf

187 MB
xet

Upload granite-4.0-350m-iq3_xxs.gguf with huggingface_hub 26 days ago
granite-4.0-350m-iq4_nl.gguf

203 MB
xet

Upload granite-4.0-350m-iq4_nl.gguf with huggingface_hub 26 days ago
granite-4.0-350m-iq4_xs.gguf

222 MB
xet

Upload granite-4.0-350m-iq4_xs.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q3_k_m.gguf

207 MB
xet

Upload granite-4.0-350m-q3_k_m.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q3_k_s.gguf

194 MB
xet

Upload granite-4.0-350m-q3_k_s.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q4_0.gguf

253 MB
xet

Upload granite-4.0-350m-q4_0.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q4_1.gguf

230 MB
xet

Upload granite-4.0-350m-q4_1.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q4_k_m.gguf

261 MB
xet

Upload granite-4.0-350m-q4_k_m.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q4_k_s.gguf

231 MB
xet

Upload granite-4.0-350m-q4_k_s.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q5_0.gguf

285 MB
xet

Upload granite-4.0-350m-q5_0.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q5_1.gguf

300 MB
xet

Upload granite-4.0-350m-q5_1.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q5_k_m.gguf

290 MB
xet

Upload granite-4.0-350m-q5_k_m.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q6_k_m.gguf

318 MB
xet

Upload granite-4.0-350m-q6_k_m.gguf with huggingface_hub 26 days ago
granite-4.0-350m-q8_0.gguf

378 MB
xet

Upload granite-4.0-350m-q8_0.gguf with huggingface_hub 26 days ago