ibm-granite
/

granite-4.0-h-small-base-GGUF

Model card Files Files and versions

granite-4.0-h-small-base-GGUF

299 GB

1 contributor

History: 13 commits

mrutkows's picture

Uploading model: run_id: Manual, workflow_ref: Manual

2cf17be verified about 2 months ago

.gitattributes

2.38 kB

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
README.md

31 Bytes

initial commit about 2 months ago
granite-4.0-h-small-base-Q3_K_L.gguf

16.5 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q4_0.gguf

18.3 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q4_1.gguf

20.3 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q4_K_M.gguf

19.5 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q4_K_S.gguf

18.4 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q5_0.gguf

22.2 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q5_1.gguf

13.9 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q5_K_M.gguf

22.9 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q5_K_S.gguf

22.2 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q6_K.gguf

26.5 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-Q8_0.gguf

34.3 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago
granite-4.0-h-small-base-f16.gguf

64.4 GB
xet

Uploading model: run_id: Manual, workflow_ref: Manual about 2 months ago