Please use the superior (tested) quant thats now been moved to ConfidentialMind org.

Cheers, Jaro

Safetensors

Model size

5B params

Tensor type

I32

BF16

F16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support