Granite 4.0 tiny 4bit
#2
by
luke9090
- opened
Hello! Thank you for your work!
I was thinking that Grinite 4.0 Tiny would be perfect for local fine tuning on a machine with 8GB of VRAM if it were quantized to 4 bits.
What do you think? You haven't made the 4-bit version yet. Would it be useful in your opinion?