huihui-ai
Collection
Models from huihui-ai
•
22 items
•
Updated
These are quantizations of the model Huihui-Qwen3-VL-4B-Instruct-abliterated.
They have been updated to use the imatrix from unsloth.
Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-4B-Instruct-abliterated
Download the latest llama.cpp to use them.
Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results. F32 > BF16 > F16
- Downloads last month
- 2,731
Hardware compatibility
Log In
to view the estimation
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for noctrex/Huihui-Qwen3-VL-4B-Instruct-abliterated-GGUF
Base model
Qwen/Qwen3-VL-4B-Instruct