unsloth
/

granite-4.0-h-micro-GGUF

Model card Files Files and versions

granite-4.0-h-micro-GGUF

52.4 GB

2 contributors

History: 44 commits

danielhanchen's picture

Upload folder using huggingface_hub

9731d5a verified about 2 months ago

.gitattributes

3.38 kB

Upload folder using huggingface_hub about 2 months ago
README.md

35.8 kB

Update README.md about 2 months ago
granite-4.0-h-micro-BF16.gguf

6.39 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-IQ4_NL.gguf

1.86 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-IQ4_XS.gguf

1.76 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q2_K.gguf

1.23 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q2_K_L.gguf

1.23 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q3_K_M.gguf

1.56 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q3_K_S.gguf

1.46 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q4_0.gguf

1.86 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q4_1.gguf

2.04 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q4_K_M.gguf

1.94 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q4_K_S.gguf

1.87 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q5_K_M.gguf

2.27 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q5_K_S.gguf

2.23 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q6_K.gguf

2.63 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-Q8_0.gguf

3.4 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-IQ1_M.gguf

838 MB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-IQ1_S.gguf

771 MB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-IQ2_M.gguf

1.13 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-IQ2_XXS.gguf

943 MB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-IQ3_XXS.gguf

1.3 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q2_K_XL.gguf

1.25 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q3_K_XL.gguf

1.58 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q4_K_XL.gguf

1.96 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q5_K_XL.gguf

2.27 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q6_K_XL.gguf

2.76 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-h-micro-UD-Q8_K_XL.gguf

3.83 GB
xet

Upload folder using huggingface_hub about 2 months ago
imatrix_unsloth.gguf_file

3.01 MB
xet

Upload folder using huggingface_hub about 2 months ago
template

6.84 kB

Create template about 2 months ago