Mungert
/

granite-4.0-350m-GGUF

Model card Files Files and versions

granite-4.0-350m-GGUF

3.89 GB

1 contributor

History: 15 commits

Mungert's picture

Upload granite-4.0-350m-iq3_xxs.gguf with huggingface_hub

091a654 verified about 1 month ago

.gitattributes

2.42 kB

Upload granite-4.0-350m-iq3_xxs.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-f16_q8_0.gguf

564 MB
xet

Upload granite-4.0-350m-f16_q8_0.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-iq3_xs.gguf

191 MB
xet

Upload granite-4.0-350m-iq3_xs.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-iq3_xxs.gguf

187 MB
xet

Upload granite-4.0-350m-iq3_xxs.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q3_k_m.gguf

207 MB
xet

Upload granite-4.0-350m-q3_k_m.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q3_k_s.gguf

194 MB
xet

Upload granite-4.0-350m-q3_k_s.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q4_0.gguf

253 MB
xet

Upload granite-4.0-350m-q4_0.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q4_1.gguf

230 MB
xet

Upload granite-4.0-350m-q4_1.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q4_k_m.gguf

261 MB
xet

Upload granite-4.0-350m-q4_k_m.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q4_k_s.gguf

231 MB
xet

Upload granite-4.0-350m-q4_k_s.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q5_0.gguf

285 MB
xet

Upload granite-4.0-350m-q5_0.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q5_1.gguf

300 MB
xet

Upload granite-4.0-350m-q5_1.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q5_k_m.gguf

290 MB
xet

Upload granite-4.0-350m-q5_k_m.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q6_k_m.gguf

318 MB
xet

Upload granite-4.0-350m-q6_k_m.gguf with huggingface_hub about 1 month ago
granite-4.0-350m-q8_0.gguf

378 MB
xet

Upload granite-4.0-350m-q8_0.gguf with huggingface_hub about 1 month ago