Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
granite-4.0-350m-GGUF
like
0
Transformers
GGUF
language
granite-4.0
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
granite-4.0-350m-GGUF
5.23 GB
1 contributor
History:
21 commits
Mungert
Upload granite-4.0-350m-bf16.gguf with huggingface_hub
b78b72d
verified
26 days ago
.gitattributes
2.75 kB
Upload granite-4.0-350m-bf16.gguf with huggingface_hub
26 days ago
README.md
36.9 kB
Upload README.md with huggingface_hub
26 days ago
granite-4.0-350m-bf16.gguf
708 MB
xet
Upload granite-4.0-350m-bf16.gguf with huggingface_hub
26 days ago
granite-4.0-350m-f16_q8_0.gguf
564 MB
xet
Upload granite-4.0-350m-f16_q8_0.gguf with huggingface_hub
26 days ago
granite-4.0-350m-imatrix.gguf
948 kB
xet
Upload granite-4.0-350m-imatrix.gguf with huggingface_hub
26 days ago
granite-4.0-350m-iq3_m.gguf
203 MB
xet
Upload granite-4.0-350m-iq3_m.gguf with huggingface_hub
26 days ago
granite-4.0-350m-iq3_xs.gguf
191 MB
xet
Upload granite-4.0-350m-iq3_xs.gguf with huggingface_hub
26 days ago
granite-4.0-350m-iq3_xxs.gguf
187 MB
xet
Upload granite-4.0-350m-iq3_xxs.gguf with huggingface_hub
26 days ago
granite-4.0-350m-iq4_nl.gguf
203 MB
xet
Upload granite-4.0-350m-iq4_nl.gguf with huggingface_hub
26 days ago
granite-4.0-350m-iq4_xs.gguf
222 MB
xet
Upload granite-4.0-350m-iq4_xs.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q3_k_m.gguf
207 MB
xet
Upload granite-4.0-350m-q3_k_m.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q3_k_s.gguf
194 MB
xet
Upload granite-4.0-350m-q3_k_s.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q4_0.gguf
253 MB
xet
Upload granite-4.0-350m-q4_0.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q4_1.gguf
230 MB
xet
Upload granite-4.0-350m-q4_1.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q4_k_m.gguf
261 MB
xet
Upload granite-4.0-350m-q4_k_m.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q4_k_s.gguf
231 MB
xet
Upload granite-4.0-350m-q4_k_s.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q5_0.gguf
285 MB
xet
Upload granite-4.0-350m-q5_0.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q5_1.gguf
300 MB
xet
Upload granite-4.0-350m-q5_1.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q5_k_m.gguf
290 MB
xet
Upload granite-4.0-350m-q5_k_m.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q6_k_m.gguf
318 MB
xet
Upload granite-4.0-350m-q6_k_m.gguf with huggingface_hub
26 days ago
granite-4.0-350m-q8_0.gguf
378 MB
xet
Upload granite-4.0-350m-q8_0.gguf with huggingface_hub
26 days ago