Hugging Face's logo

noctrex
/
Huihui-Qwen3-VL-8B-Thinking-abliterated-GGUF

Image-Text-to-Text
GGUF
conversational
Model card Files
xet
Community

These are quantizations of the model Huihui-Qwen3-VL-8B-Thinking-abliterated

Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated

Download the latest llama.cpp to use them.

Downloads last month
922
GGUF
Model size
8B params
Architecture
qwen3vl
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Qwen3-VL-8B-Thinking-abliterated-GGUF

Base model

Qwen/Qwen3-VL-8B-Thinking
Quantized
huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated
Quantized
(3)
this model

Collections including noctrex/Huihui-Qwen3-VL-8B-Thinking-abliterated-GGUF